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Within the framework of the Ro 

» method the experience-type, the ratio of 
man movement (M) to weighted color 
Sponses (Sum C), although central to R 
Schach’s thinking [15], is in actual pract 
rather difficult to employ, as Beck [1] $ 
Pointed out. Part of the difficulty stems “yif - 
haps from Rorschach’s somewhat arbit 
Juxtaposition of two types of response Wi 
result from rather disparate perceptual pro 
iad The situation is ameliorated somewhi 
Y'the fact that Rorschach has presented fai 


specific indications of the behavioral signi 
ca of « eas » ful pap 


that a triadic relationship.exists between overt 
motor activity, perception of movement, and 
i imaginative processes. He indicated that per- 
= ception of humans in motion on the inkblots 
was correlated on the one hand with “greater 
creative ability,” “more ‘inner’ life,” and on 
the other hand, with “stable, measured motil- 
ity’ [15, p. 78]. He specifically asserted that 
“Kinesthetic engrams, therefore, act as inhibit- 
ors of physical activity; motor activity inhibits 
kinesthetic engrams” [15, p. 80]. Schachtel 
has summarized this view of the kinesthetic 
(M) response very effza% i 


“hae 


eae? 

. .. the kinesthetic percept is accompanied by ar- 
rested, checked motor innervations. Instead of being 
carriec2out, these innervations lead to empathy with 
movement observed in the environment, or to kines- 
thetic imagery as in kinesthetic percepts in Ror- 
schach’s test or as in dreams where motor activity 
is suspended by sleep [16, p. 87]. 
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Sons with a clear preponderance of one 
oe of the ratio. As part of a progra 
jen designed to integrate key Rorsc 
‘a rminants with ogeneral theories of percep- 

n and thinking, one focus of this study will 

s; S on the correlates of Rorschach’s experience- a a: k $ 
“YPC as given in the M :Sum C ratio. Because The challenge of this triadic relationship 
Cf. the interesting theoretical implications of lies in its ready application to theories and ob- 
tie Dünari movement response, however, pri- servations concerning the development of 
mary emphasis in this study will be upon the thought which stem from diverse investigators 
resp ee Sonen of Rorschach’s ratio. The color in the fields of psychology _and psychiatry. 
POnses will be considered primarily from -Thus, Freud in presenting his concept of the 


ec Point of view of how their presence in reality-principle as a key phase of ego develop- 
nodifies the observed relationship ie ment also pointed to the relationship between 
oe rs 


M and overt behavior. a 7i. thought and restraint of motor discharge. He 


Tgely on the basis of intuition and em; described thought as “endowed with qualities 
cal observation Rorschach [15] projiose” which made it porsible for the mental appa- 
on i a Pi ratus to support increased tension during a de- 
Published ed in the Veterans Administration ant ]iy in the process of discharge. It is essentially 


Ife with the approval of the Chief Medica’ sofia? . z 
an a a E need an experimental way of acting . . P (4, p: 16]. 
ne reflect the opinioni or policy of the Veteran. Other psychoanalytic theorists [2, 3, 13] have 
P¥chologicg me, The aytaors are indehfed to clinica elaborated on Freud’s views but generally 
sag s TE Tainees Jack Herman—n au ere- : . eos 
el ; 
assi 26 to the staff of the PsycHology Service for seem to concur in relating tke origin of 


1 
pean j 3 Servi PER ` : 
in various phases of the investigation. thought to a delay or inhibition of immediate 


La 
Piri 


2 


need gratification through motor activity. 

Somewhat similar theories supported with 
some empirical data are presented by Piaget 
[11], Lewin [8], and Murphy [10]. All havé 
in common a conception that the development 
of imagination and planful fantasy are con- 
comitants of the increased restriction of the 
growing child’s motility as well as of the en- 
forced socialization of his egocentric speech pat- 
terns. To the extent that Rorschach’s M repre- 
sents fantasy activity, developmental findings 
with the inkblots are consistent with these the- 
ories. Thus, M first appears as a rule4nthil- 
dren’s records at age six, at a time when school 
attendance markedly curbs motility and en- 
forces socialization [7, 19]. Differences be- 
tween schizoid and normal children [19] or be- 
tween disturbed children producing different 
amounts of M [7] also appear to be in accord 
with these theories. 

With respect to the actual perceptual proc- 
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ess in the production of Rorschach movement , 


responses, experimental literature in perception 
and physiological psychology offers some clues 
(20, 21, 23]. Werner [21], for example, has 
hypothesiincu cl.” “mon dynamic property, 
tonicity, underlies both sensory and motor re- 
sponses. Available tonic energy may be released 
through body movement or may increase to- 
nicity In a sensory area bringing about “spatial 
displacement and the illusion of motion. 
Experimental support for this point of view 
with particular implications for Rorschach 
theory has come in a series of experimental 
studies [5, 23] and in comparisons of the per- 
ceptual and Rorschach behavior of feeblemind- 
ed children who represent contrasting tenden- 
cies to motor activity [21, 22]. Thus, the 
hyp-_dctive exogenous feebleminded showed 
fewer Rorschach movement responses than did 
the motorically phlegmati: endogenous feeble- 
minded [22]. Evidence that the number of M 
produced on the inkblots by norm 
following a period of motor inhibition [9 18] 
also suppo.ts Werne.’s hypithesis. Of partic 1- 
lar interest for the present study was the find- 
ing that the number of 7 initially producéd 
by subjects was Positively correlated with their 
subsequent ability to inhibit motor response 
[9]. 

Concern ii: the present investigation will be 
with M in its hypothecical relation to motor 


als increases- 


mals. In the sphere of spontaneous motor ac- 


„task and less motor activity during a waiting , 


è 
{ 
behavior rather than with its presumptive cor- 
relates ine fantasy and i.aagination. To ascer- 
tain the generality of findings obtained prev!- 
ously with normals, this study was extended 
to ‘nclude a psychopatholoyical group, Le. 
schizophrenic males. In addition, a situation 
designed to elicit evidence of spontaneous mo- 
tor activity and environmental responsiveness 

was utilized, since previous research [9, 18] 
had been limited to fairly specific motor inhi- | 
bition tasks. It was felt that on theoretical q 
grounds the presence ~% M responses in the 

Rorschach records* ot schizophrenics woule 

bear the same general relation to moter inhi- 

bition that was observed in studies with nor- | 


tivity, however, the color responses in the-iI2+ 
Sum C ratio might be expected to play a role 
ii) determining the degree of responsiveness. 
‘J his study, moreover, involves the behavioral 
correlates of Rorschach’s M and C categories 
ap elicited in standard clinical administrations | 
cf the test rather than in the quantitative 
vhanges in these responses following inhibition 
Qs in the earlier work "9, 18]. For this reason 
the present study may be expected to, throw 
some light more directly upon vival interpre- 
tations of the response categories oriented to- 
ward description of personality structure. 


The Experiment 


Hypotheses. The following hypotheses were 
formulated : 

1. Schizophrenic groups chosen as extremes, § 
of introversive or extratensive experience-types 
will differ significantly in two behavioral situa- 
tions. Introversives (M > C) will show 
longer inhibition times in a motor inhibition 


period than extratensives (C > M). 

2. Schizophrenic Ss who have produced sev- 
eral human movement responses in the! Rot — 
schach protocols (High-/Z group) will show 
longer inhibition times and less waiting-roo™ 
activity than- an equated schizophrenic group 
who have produced relatively few Rorschac? / 
M (Low-M group). i 

3. The greater the numbe: of Rorschac” 
color responses in the® patients’ records, th® 
greater will he the tendency for enyironment® — 
responsiveness through motor activity during 4 
the waiting period. If, however, Hypothes's 4 © 


is confirmed, the quantity of celor responses 
may be expected to exercise a modifying rather 
than a determining influence upon the amount 
of motor activity. 

Subjects. The Ss were 50 male veteran pa- 
tients officially diagnosed as schizophrenic. 
They were divided into two groups of 25 Ss 
each on the basis of the M responses in their 
Rorschach protocols.” Those producing more 
than ‘one AZ were designated aş the High-M 
group while those whose records yielded one 
M (usually Card- IIT} 2r less composed the 

ow-i1 group. These groups were equated for 
other yariables which might conceivably be re- 
lated to the experimental situation, ¢.g., age, 
duration of hospitalization, IQ, and Rorschach 
Scoves. Table 1 presents comparisons of the 
Means for all groups on certain pertinent vari- 
ables, Others which showed low incidence are 


“Tt 


< 


the should be noted that this study is limited, 
all Ki e of the human movement determinant wi 
mye er movement percepts, animal and inanima’ 
[9 Tes (FM and m), controlled. Previous studies 
tugged have yielded mixed results, occasionally 
havies ng that FM, m,eand M have common be 
enges correlates, occasicnally suggesting diffe 
ormu] etween them. Since Rorschach’s original 
Of hu ations severe clearly related to the experience 
singled <” movement, the M responses have been 
i € out in this study for the sake of simplicity 
‘sign, 


f Behavioral Correlates of Rorschach's Experience-T ype Fi 


2 
> 


A 
omitted as are percentages For the High- and 
Low-J{ grotps only the difference in M was 
significant Both groups contained approxi- 
fnately equal numbers of the various subtypes 
of schizophrenia, predominantly paranoids and 
hebephrenics in this sample.* 

In order to test the hypothesis concerning 
introversion and extratensiveness, two equated 
groups of Ss chosen as the extremes of the M: 
Sum C ratio for the patient population were 
also employed. These groups were chosen to 
exclude Ss with “coarctated” or ‘“‘ambiequal” 
ratios. These groups consisted of 19 introver- 
sive Ss and 16 extratensives who were equated 
on all variables except M and C. Data for 
these groups are also presented in Table 1. 
Only the differences in M, CF, C, and Sum C 
are significant. 

Procedure. The Ss underwent the following 
sequence of procedures: 


1. Waiting-room observation 


8Diagnoses were made by admitting psychiatrists 
and were corroborated by ward psychiatrists. There 
seemed to be little relationship between the subtype 
of schizophrenia and the Rorschach protocols of thes==> 
200 patients from hormesis eapeee tal samples 
were drawn. Most patients revealed paranoid de- 
lusions after some probing in any case, and patients 
with rather similar delusional content could be 
found in both High- and Low-M groups. 

e 


Table 1 ; 
Group,Means for High- and Low-M and Introversive-Extratensive Groups 
ai on Age, IQ, and Pertinent Rorschach Variables 


je Groups 
Matching variables High-M Low-M lntroversive-extratensive 
5 (N = 25) (N = 25) (N= 19) (N= 16) 
Personal data 
ge 32.56 ' 32.88 33.84 32.19 
“IQ (Wechsler-Bellevue) 116.50 113.00 114.00 120.78 om 
rschach determinants 
R 24.84 19.36 22.00 « 22.94 
M 3.84* .60* 4.05* 1.13* 
. Fy 4.16 3.04 4.11 3.19 
m j .60 52 +68 50 
(eu 80 1.16 5h 1.56 
£ 1.80 > 84 S 132° ` 94 
F 10.08 8.76 9.05 9.81 | 
+ % (Beck) r © 83.88 80.60 85.53 82.13 
c : 1.72 1.88 1.20* 2.31% 
T / 1.04 1.88 42* 281" 
S = ë A8 32 -08* .94* 
um G,- A a 2.60 3.22 92% 5.34* 
9 Di 


ond extr 


` 


ferences between the means of High- and Low-M groups in M and between means of introversive 
‘atensive groups in M, FC, CF, C, and Sum C-are significant beyond the .05 level, 
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2. Motor inhibition task 
3. Brief interview 


The waiting-room observation was a procedure 
modified from studies carried out by Rickers-Ovsian- 
kina [14]. The S was conducted into the ward 
visitors’ room, a customary waiting room in the hos- 
pital. He was informed that E would call for him in 
about 15 minutes and was told to spend his time 
as he chose. The § was seated near a table on 
which were spread a large number of puzzles and 
colorful test objects, including such things as Iso- 
chromatic Color Plates, Lowenfeld Mosaic pieces, 
various mechanical aptitude tests such as nut and 
bolt assembly, etc. At the far end of the room, ap- 
parently working on some papers, was the observer, 
who was almost always unknown to the patient. The 
observer recorded, according to prearranged plan, 
all movements, activity, and speech of the patient 

_ during the 15-minute period, Recording sheets 
broken down into 15-second intervals were used, 
and the observer entered each change in position, 
obvious shift in attention, gross movement or com- 
ments, manipulation of materials, etc. These obser- 
vations proved relatively easy to make, particularly 
since there were no others in the room and clear 
vision of S’s activity was possible, The presence of 
the observer did not seem to disturb the patients, 
who were accustomed to finding strangers seated in 

~ his room while waiting for psychiatric consulta- 
tions, Subsequent “questidning revealed that only 
two paranoid patients guessed the function of the 
observer, Any comments addressed to the observer 
by S were included in the protocol as part of a re- 

Sponse to environmental stimulation. [a] 

Protocols were rated on a six-point scale for de- 
gree of motor activity and environmental response. 
Each point was defined as an aid in rating based 
upon a preliminary sampling of the various activi- 
ties manifested by patients in a waiting-room situa- 
tion. The definitions were as follows: 

0 = No gross motor activity other than stretch- 
ing, scratching, smoking, minor finger movements, 
foot tapping. 

1 = No gross motor activity other than playing 
wit! ‘Personal objects, e.g., glasses, shuffling cards, 
toying with pencils, etc. 
= Some minimal m-vement around room, 
reading, looking at objects on table (without 
manipulating them), or doing crossword puzzle 
brought into the room by S. á 

3 == Some speech, so.ne movement around room, 
evidence 6£ hallucination, laughing, loud and ptr- 

sistent whistling, other gross motor activity, e.g., 
picking up one or two objects from table and tx- 
amining them. £ 

4 = Fairly«extensive motor activity, playing with 
many objects on table, or a few such objects for a 
very long time, occasional comments to observer or 
to self. d 

5 == Considerable restless motor activity or speech, 


noticing and manipulating many objects, addressing 
observer or persons passing outside the room. 

Protocols were rated by two judges without 
knowledge of S's name or group. One judge made 
separate ratings a month apart as well. Rater re- 
liability was determined by product-moment cor- 
relations. Final waiting-room data consisted of the 
average of the three ratings. 


The motor inhibition task consisted of a pro- 
cedure adapted from the Downey Will-Temperament 
Scale. This task called for S to write the nhrasé 
“New Jersey Chamber of Commerce” as slowly a$ 
he possibly could without lifting pencil point from 
the page or stopping motion of the pencil. This tas! 
had been employed in prior research in this series 
[9]. The Ss were informed that they were helping 
in the standardization of a new testing procedure. 
The task proved relatively simple and was easily 
comprehended by the patients, who cooperate 
readily enough. As a check on cooperation a wrt- 
ing sample at normal tempo was obtained to be 
sure that $ had made a definite effort to inhibit his 
motor response. The test phrase was written in pen 
cil across an 8-inch page between 14-inch parallel 
lines to maintain approximate uniformity in size 
Data for this task were based on the inhibition 
times taken in seconds. 

The interview followed immediately and con- 
sisted of an exploration within the limits of the 
patient’s accessibility, of S’s daydream and other 
thinking activity, its preferred form and content 
Patients’ comments concerning their own motor ace 
tivity were considered as well. It was not possible 
at this time, however, to get very much information 
concerning motivational aspects of the REECE 
fantasy life. | 

The Rorschachs, administered originally by the 
hospital staff in the course of diagnostic examina- 
tions, were rescored by the senior author. In the 
few cases of discrepant scoring the judgment of 
third experienced clinician was relied upon for 3 
final decision. Klop'fer’s scoring was used. 


Results 


The human movement determinant. ‘The 
relative simplicity of the motor inhibition sitt 
ation resulted in good cooperation by patients: 
Even those Ss with lowest inhibiticn time 
wrote the test phrase at least four times, as 
slowly as the normal writing sample. Scoring | 
of the waitir g-room protocols according to the 
activity scale also proved relatively simple. 
average interrater reliability coefficient (b 
on z transformations) was r = +.85. Dat 

4A third’ experimental Situation, mirror tracin® 
had to be abardoned early in the development 


the study when it proved too difficult anc .disc? 
certing to Ss, who frequeutly rejected it. Y 


ase? 


Presented for this variable are based on the 
average of three ratings. Results for the High- 
and Low-i groups and the introversive-extra- 
tensive group on both variables are presented 
in Tables 2 and 3. It should be noted that 
where specific directional differences were 
Predicted the value of p/2 is employed to indi- 
cate significance.’ 


Ea Table 2 
Inhibition Times and Waiting-Rooih Activity Scores 
iy for High- and Low-M groups 
Experimental situation means 
Groups Inhibition time Activity rating 
F (secs. ) 
High-Mm 277.56"° 1.84** 
en 138.40 3.09 


+s n p 
Difference between group means is sig. at p<.0l. 


ae Table 3 oe 
nhibition Times and Waiting-Room Activity 
Ratings for Introversive and Extratensive 


Groups 
Experimental situation means 
Group Inhibition time Activity rating 
Tame (secs. ) 
Tntroversives 
pet > Sum C) 266.16" 1.66%* 
xtratensives 
Sum C > M) 139.63 3.28 


+D 
Difference between group means significant at p <-01. 


ust the data itsseems clear that the High- 
ik a shows considerably longer inhibition 
pits and considerably lower activity scale 
tle than the Low-M group. These re- 
ute S tend to support the hypotheses. A prod- 

*‘Moment correlation between M and inhi- 


‘tion time yields an r of .29, which is signifi- 


T =<  ~— 


ant at $ <05. The product-moment r for M 


wien vaiting-room activity scores is —.23 
tion h barely misses significance. The correla- 
What “ween M and inhibition time is some- 
Studi lower than that obtained “in earlier 
l rel, With normal Ss [9], but this most like- 
„cHects the typically greater variability of 


diffe, phrenic Ss as well as some procedural 


T 4 $ 
ences between the experiments: 


5S; 

Rificantt the contrasted groups did not differ sig- 
ber of ap 1n total responsef (R) the absolute num- 
fu Was employed’ Statistical checks on the in- 
47o and other determinants as a func- 
id not alter the trend of the data. 


D 
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Previous studies had ge 
considering certs rahtative a 
M response [18, vot lertainly a corollary of 
the major hypothesis would be that those Ss 
who produce JZ responses that are more active 
or vigorous in the ascribed movements may be 
expected to show greater inhibition and less 
spontaneous motor activity in their own be- 
havior. To test this possibility the human move- 
ment responses for the 25 High-M Ss were 
rated for active (“Man running, girls danc- 
ing?) versus static movement (“Woman 
staring, man sleeping”). It was possible then 
to subdivide the High-JZ group into the 15 Ss 
who showed two or more active JZ and the 
10 who showed less than two such responses. 
The results presented in Table 4 reveal that 
even within the High-M group significant dif- 
ferences emerge; those Ss who emphasize ac- 
tive M tend to have longer inhibition times and 
lower activity scores than the patients who gave 
more static M. When the total sample of 50 
Ss was broken down into those with prepon- 
derantly active or static JZ a similar finding 
emerged. These rather clear-cut findings lend 


further support to the hypothesized relations” 


ship between motion perception and motor in- 
hibition. They also suggest, pending further 
research, a necessary refinement in interpreta- 
tion ef Rorschach, i.e., consideration of the 
vigorousness of movement. Exploratory scor- 
ing of M as flector and extensor and aggres- 
sive (“men with clubs”) or passive (“young 
cherubs dancing”) content failed to yield any 
additional information relevant to the hy- 
potheses. 

The experience-type. Results in motor inhi- 


Table 4 P 
æ» 


Inhibition Times and Waiting-Room Activity 
Ratings for High-M Ss Producing Active 
and Static M 


Experimental situation means 


Group Inhibition time Activity rating 
3 (seca) b 
Active-M © 
“(N= 15) 377.9%" 1.40* 
Static-M 
(N=10) 127.1 2.50 


* Difference between group means significant at p 
<.02>.01. 


** Difference between group means significant at p <.01. 
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bition and waiting-room activity for the intro- 
versive and extratensive experience-type groups 
are presented in Table 3. They reveal signifi- 
cant differences paralleling those with M alone: 
Introversive Ss show significantly longer inhi- 
bition times and significantly less waiting-room 
activity than do extratensives. Since these re- 
sults, obtained with groups differing in both 
M and C, are quite similar to those obtained 
when only the number of M was used in sepa- 
rating groups, they suggest that it is the M 
response alone rather than the AZ:Sum C ratio 
which is crucial in relation to motor activity. 
It should be kept in mind that several Ss in 
the High-M group were technically extraten- 
sive; they showed even more color responses 
than human movement responses. This domi- 
nant role, played by the M response alone, 
while in accord with the sensory-tonic theory 
casts some doubt upon Rorschach’s emphasis 
on the experience-type per se. 

Closer scrutiny of the results, however, does 
indicate the Possibility that the color responses 
in the ratio do have some influence, particular- 
dy in the waiting-room situation, which may 
evoke spontaneous motor response. Thus, in- 
spection of Table 2 indicates that when M 
alone is the basis for group division the differ- 
ence in waiting-room scores for the contrasting 
groups is somewhat below that which Obtains 
when both M and C are considered as in Table 
3. In the breakdown by active-static M in 
Table 4, the waiting-room score differences 
between the groups are again lower, although 
significant. In both High- and Low-M and in- 
troversive-extratensive analyses, partialling out 
of the color factor reveals a slight although in- 
significant increase in the negative correlation 
of Myand waiting-room activity. 

Far more suggestive of a real influence of 
color; however, afe the results obtained when 
the actual ratio of M :Sum G rather than in- 


troversive-extratensive types are considered.. 


Statistical treatment f this ratio involved di- 
vision of the High- and Low-M Ss into High- 
and Low-C subgroups using a Sum G of 3.0 
-(the sample mean) or le§s as a basis for assigh- 
ment to the Low-C group. Results are presented 
in Table 5, which reveals that motor inhibition 
scores vary chiefly as a function of the number 
of M. On the other hand, a marked increase 


m o 


Table 5 
Inhibition Times and Waiting-Room Activity 
Ratings for High- and Low-M Ss 
Subdivided by Sum C Scores 


Rorschach Experimental 

means situation means 
Group Inhibition Activity 
M SumC time (secs.) rating 
High M: Low C 

w= 3i 0.8 247.3 1.66 
High M : High C ] 
(N =8) 5i 6.3 298.0 2.23 
Low M : Low C h 
(V=13) O04 14 139.4 282 
Low M: High C me: 

(N= 12) 0.8 5.0 127.0 3.3 


aint 
in waiting-room activity scores is observable as 

we move from the High-M:Low-C group 

through High-M:High-C, Low-M :Low-C, 

and, finally, Low-JZ:High-C. This is so de 

spite the fact that the High-M :High-G group 
actually averaged more M responses than the 

High-J4:Low-C group. Although the differ’ 
ences from subgroup to subgroup are not sig” 
nificant, the regularity of the increase in activ’ 
ity with the increasing weight of color in the 
experience-type ratio points to a clear influence 
of the color factor upon the waiting-room ber 
havior. Analysis of variance for the waiting’ 

room activity scores in the four subgroups | 
yields an F of 4.36 which is significant beyond 
the .01 level. ' 

Qualitative observations. Although each paz. 
tient was interviewed briefly following the: 
motor inhibition task, the severity of the path 
ology in many cases prevented satisfactory com” 
munication. To some extent those individuals | 
who reported tendencies toward active fantasy + 
lives such as heroic daydreams or reviewing 8 | 
past events or future plans tended to fail i# 
the High-M group. Some Ss who showed Low 
M production but comparatively little moto 
activity reported that they tended to lose the™ 
selves in viewing television or in focusing 2” 


minute bodily changes with consequent soma” 
delusions.! 


3 1 | 

On the whole, patients in theLow-M :Hig™ 
C category tended to’ have spent more time ©” | 
the “violent” ward because of hyperactive ?”, | 


. r Gi 
havior. High-M *‘Low-C patients were mo" 


likely to be found on the privileged ward or 
were considered relatively “well-behaved,” al- 
beit severely ill, by ward personnel. In rough 
confirmation of Rorschach’s [15] discussion of 
Persons with “dilated” experience-types, it was 
observed that High-J/:High-C Ss tended to be 
among the most “interesting” patients in the 
hospital. They were usually better known to 
| Personnel and tended to demand and receive 
More attention while “coarctated” Low-M : 
Low-C Ss, for example, tended to be less 
£ known by name and more inconspicuous. 
| An example of a patient whose record showed a 
High-Af : High Sum C ratio and who typified char- 
P acteristics of a “dilated” experience-type may be 
| cited, This man was a severely disturbed paranoid 
Schizophrenic whose ratio was 8:24, revealing more 
| 7 and more C than any other patient in the popu- 
| 
| 


ation of 200 from which the equated groups were 
fe oo Although stemming from a low socioeconom- 
tenth ground this man attracted considerable at- 
and a because of the variety of his talents, fluency 
tivi eloquence of his speech, and his physical ac- 
"ty and vigor, On the one hand he revealed su- 
Petion linguistic gifts and artistic talent while at 
eh en time he was thè outstanding athlete in m 
manife A This man’s drive ‘for physical activity was 
inp; sted in his performing calisthenics between 
ludo ne pitching softball. He spoke rapidly, 
(o fe and almost interminably in group therapy 
è conversation, Yet he was capable of sitting on 
plep ee for long periods of time, almost — 
imagin Motionless, weaving elaborate and hig y 
e pl PRSE fantasies of heroic achievements or 0 
ae ots devised agaimst him. Both the M and C n 
although his personality could be readily observe 
Hsi aa the hyperactivity predominated in behav- 
“s in the experience-type ratio. 


Pe 


Discussion 


a he results of this study tend in general to 
consa. Suggest several implications that genr 
Tact eration theoretically as well as in clinica 
ice, i 
studi bese findings support those of previous 
for R [9, 18, 22] in suggesting some validity 
Percene;  Pach’s empirical association of „the 
blots ane of humans in moticn on the ink- 
trolleg S tendencies toward inhibited or con- 
ence rhe Otor respoase [They offer some evi- 
asmuch F the generalicy of the relationship in- 
Pathol “S they were obtained from a markedly 


e °Btcal group of Ss, schizophrenic pa- 
a 


a 


so Port the experimental hypotheses. In doing” 


g 
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tients, while the previous studies involved 
normal adults [9, 18] or mentally defective 
children [22]. Thus, despite the anticipated 
variability of the patients and the consequently 
lower correlation between JZ and the motor 
inhibition task, the trend for the production 
of several Rorschach JZ to be associated with 
comparatively greater capacity to inhibit writ- 
ing speed emerges again. Although the low 
correlations preclude prediction in the individ- 
ual case they suggest that the AZ response has 
a common interpretive significance across nor- 
mal and abnormal groups. This does not deny 
the necessity for considering other factors in the 
Rorschach protocol which may counterbalance 
the JZ or alter its interpretation somewhat. At 
the same time it seems clear that as a percep- 
tual or apperceptual phenomenon presumably 
exemplifying some general behavior principle, 
the human movement response to the Ror- 
schach inkblots has definite correlates in behav- 
ior quite apart from the immediate testing 
situation. 

2. Of particular theoretical interest is the 
nature of these correlates of AZ. The fact that 
individuals chosen on the basis of contrasting 
tendencies to perceive humans in motion on ink- 
blots tend to differ in their capacity to inhibit 
motion or to move about in a waiting room 
supports the view that perceptual response re- 
flects pervasive behavior characteristics. More 
specifically, theories implying a vicarious re- 
lationship between motion perception and overt 
movement, of which the sensory-tonic theory 
[21, 23] is an example, gain support from 
these findings. Whether Rorschach’s M reflects 
imaginativeness or fantasy processes as well as 
tendencies toward motor restraint remains a 
question for further research. The positie re- 
sults of this study offer encouragement for an 
attempt to explore the interrelations of motion 
perception, fantasy, and motor activity with 
the ultimate aim of developing the unified 
theory of thinking now only speculatively sug- 
gested by the writers cited in the introduction 
[8, 10, 11, 13]. 
>3. The data of the experiment throw com- 
paratively little light on the knotty problem of 
the experience-type ratio, however. Most of 
the data suggest that the quantity of M rather 
than the experience-type as given in M > C 
vs. C > M is most potent in determining mo- 
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tor responsiveness. The results presented in 
Table 5 suggest, however, that the role of 
color cannot be ignored. The amount of spon- 
taneous motor activity in the waiting-room 
situation varied with a quantitative relation- 
ship between M and C somewhat different 
from that implied by introversive-extratensive 
ratios. The observed relationship suggests that 
while is the primary factor related to motor 
inhibition, color, reflecting the individual re- 
sponsiveness to the environment, to some ex- 
tent counterbalances this tendency. Since the 
influence of color emerged only in the waiting- 
room situation (which might be considered 
evocative of more spontaneous performance), 
the interpretation of the color factor as re- 
flecting environmental responsiveness or out- 
going tendencies [6, 12, 16] would appear 
consistent with the data. Whether it is the 
color qua color or merely a tendency to respond 
in diffuse associations with lessened considera- 
tion of blot contour [17] which reflects S’s 
characteristic emotional or motor lability is a 
question beyond the scope of this investigation. 
e Nevertheless, the finding that some influence 
of the actual experience-type ratio exists is 
quite important for validation of Rorschach’s 
original interpretations and merits more inten- 
Sive scrutiny. 


A final word may be said concerning the 


implications of the results for research in the 
field of projective techniques. It seems clear 
that experimentation in the theory and process 
of clinical instruments is possible. The question 
seems to be one of finding concrete situations in 
which the somewhat nebulous personality de- 
scriptions can be expressed operationally. The 
interaction of various factors and the neces- 
sary ideographic approach of the clinician 
need not constitute an insurmountable ob 
stacle. The origitial assignment of interpre- 
tative meaning to the determinants on Ror- 
schach’s part was, as he makes quite clear 
drawn from his observation of their correlates 
in overt behavior. Even ir? “global” interp%e- 
tatien some aspect of the “nuclear definition” 
12] of the factor is ‘necessarily preserved. 
Thus, one need not expect to find very high 
correlations in group data, but low, signifi- 
cant correlations should emerge, as they have 
in the present series of studies, 


This study was part of a program of re- 
search designed to integrate key Rorschach de- 
terminants within a more general theory of 
perception. Previous studies have revealed a re- 
lationship between inhibition of motor response 
and the tendency to produce human movement 
percepts (JZ) on the Rorschach, a finding 19 
keeping with Werner’s sensory-tonic theory of 
perception [21] as well as with certain theo- 
ries of thought and its development [4, 8, 10, 
11, 13]. The present study extended this re- 
search to include a pathological group (schizo- 
phrenics) and also focused attention on the 
experience-type (M :Sum Color) ratio as well 
as M alone. It was hypothesized that schizo- 
phrenics producing several M percepts wow! 
show greater tendency to inhibit overt motor 
response than a comparable group which pro- 
duced few M. Similarly schizophrenics with 
introversive experience-types were expected to 
show more motor inhibition and less sponta- 
neous gross motor activity during a waiting 
period than extratensive Ss. It was anticipate 
that the number of A/Z responses would prove 
most effective as an index of motor inhibition, 
with C responses, however, influencing the ten- 
dency towards spontaneous motor activity. 


Á 
Surmary and Conclusions 
; 


Fifty hospitalized male schizophrenics were 
divided into two groups on the basis of produc 
tion of two or more, or one or less, Rorschach 
M responses. These groups did not differ sig 
nificantly in age, intelligence, type of schizo- 
phrenia, length of hospitalization, or in pro^ 
duction of various Rorschach determinants 
other than M. Extreme introversive and & 
tratensive groups were also employed equate 
for all factors except the M :Sum C ratio. 

The Ss were studied in two situations, m0” 
tor inhibition and spontaneous motor activity, 
The former called for the writing of a brie 
Phrase as slowly as possible without stoppin’ 
motion of the pencil. The times taken to writ? 
the phrase furnished the data for this task. Ty 
second situation involved recordings by an 0 
Server of a patient’s waiting-room behav! 
during a 15-minute period. Protocols w?" 
rated independently acrording to a scale of 
gree of grdss motor activity and response to er 
vironmental objects. Interrater  reliabiliti@? j 
yielded an average'r of .85. 


po 


Behavioral Correlates of Rorschach’s Experience-Type 9 


Results generally tended to support the hy- 
theses. Thus, the, High-JZ group showed 


significantly longer inhibition time and signifi- 
cantly lower waiting-room activity scores than 
did the Low-JZ group. "The introversive Ss 
differed in parallel fashion from the extraten- 
Sives. When the human movement percepts 
Were rated for relative vigorousness of activity, 


Ss 
to 


who showed predominantly active M proved 
have longer inhibition time and less waiting- 


room activity than Ss producing static M. To 


ch 


eck the role of color responses High- and 


Low-Af groups were subdivided into High- 
and Low-Sum C groups. Although color did 
not appear materially related to motor inhibi- 
7a performance, a regular increase in wait- 
a§Toom activity scores emerged with the in- 


Cre, 


ased weight of the color in the M :Sum G 


Tati h A . . 

Bia The results of the investigation corrob- 

ee in a limited way some of Rorschach’s 
‘ginal formulations and suggest that the in- 


terre] 


ations of motor activity, perception of mo- 


tio; . i 
S n, and fantasy behavior offer a fruitful area 
D expert! 
eXperimental research. 
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A Comparison of Raven’s Progressive Matrices 
(1938) with a Short Form of the Wechsler- 
Bellevue’ 


Bert Levine and Ira Iscoe 
University of Texas 


The Progressive Matrices (1938), and a 
short form of the Wechsler-Bellevue Form I 
consisting of the Comprehension, Vocabulary, 
and Block Design subtests, were given to 60 
undergraduates. There were equal numbers of 
males and females. The average age was 19.1 
years. Each § was first given the P.M. and 
then the W-B subtests. Administration and 
scoring were in accordance with the directions 
= given in the respective manuals. The mean 
score on the P.M. was 50.8 with an SD of 
6.6. No significant sex differences were found. 
A Pearson r of .55 was obtained between the 
total P.M. score and the total weighted score 

a 


1An extended report of this study may be ob- 
tained without charge from Ira Iscoe, Department 
of Psychology, University of Texas, Austin, Texas, 
or for a fee from the American Documentation In- 
stitute. To obtain it from the latter source, order 
Document No. 4159 from ADI Auxiliary Publi- 


cations Project, Photoduplication Servi ib: 
Congress, Washington 25, D.C, miles oe 


vance $1.25 for microfilm or 
copies. Make checks pay 


cation Service, Library of Congress, 


t 


of the three subtests. Individual weighted sub- 
test scores correlated with the P.M. total, 
follows: Comprehension .21, Vocabulary -48 
and Block Design .63. Set E of the P.M., com- 
posed of the 12 most difficult items, correlate 

-52 with the short form of the W-B, and .23 


with the Comprehension, .47 with the Vocab- 


ulary, and .56 with the Block Design subtest 
weighted scores. Set E by itself correlated .8 
with the P.M. total. ‘The P.M. appears t0 
tap areas of intelligence most closely related t0 
Block Design and not significantly related tO 
Comprehension. As one moves away from cuk 
tural loadings on the W-B subtests, the cot’ 
relation increases markedly. Inasmuch as thé 
P.M. is easily administered, untimed, and de 
mands no speech and only a minimum of motor 
ability, its possible utility as an intelligence 


test with people having certain types of sensory.. 


and motor handicaps as well as illiterates an 
foreign born deserves further investigation. , ' 
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Rorschach Performance in Relation to Two 


a 


Types of Stress ` 


Murray S. Stopol 


Teachers College, Columbia University ? 


o 
In the past several years invèstigators have 
“become more cognizant of individual differ- 
ences observed in performance under stress. 
The fact that some persons show a decrement 
«ou Performance, while others show improve- 
Ment, and still others have an initial decrement 
et by improvement, has led ps chologists 
sults ws ute these seemingly inconsistent ae 
Situatio, such factors as (a) the kind of stress 
he er employed, (b) the type of motivation 
Persist Ject uses, i.e., ego-defensive or need- 
ity i ai, and (c) the subject’s other personal- 
E S The problem of individual 
levees to stress is of practical as well a 
new ical importance. For example, if we 

-«-” More about the nature of these individual 
“ences, it might enable us to predict who 
e adversely affected by a stress situa- 
t the same time, selection procedures 
e readily improved in schools, in indus- 
ean especially in military service, where 
tellect, ae frequently required to perform 1n- 
«tual and skilled tasks under conditions of 


Astra 
Ý action or threat. 


1C most widely used instrument to assess 
vali variables associated with behavior 
iting ant s has been the Rorschach test. Con- 
ste seems to exist with respect to 

Is a lonship between behavior under var- 
ac pes of stress conditions and alleged Ror- 
indices of stress tolerance. Williams 

» Waldman [15, 16], Smith and George 
> and Baker and Harris [2] found a defi- 
ed“; Present Paper is part of a dissertation pre- 
Partial fulfillment of the reouirements for 


Bree of Doctor of Philosophy at Teachers Col- 


Š prewmbia University, 1951. The writer wishes 
en, Jr. y his thanks to Drs. Edward Jcseph Sho- 


Pergo, 
Unde 


then ieaiao committee chairman), Paul E. Eis- 
i : one 4 ance F. Skaffer for 
2 invaluable a s, an? Laur 


dvice a.id criticism. 


S Minn ns Administration Hospital, Minn- 
€sota and the University of Minnesota. 
. a 


nite relationship between Rorschach measures 
and reactions to stress, while Allee [1], Erik- 
sen, Lazarus, and Strange [9], Deese and 
Lazarus [6], and Carlson and Lazarus [4] 
found no relationship. Among the major possi- 
bilities that exist in attempting to resolve these 
differences in results are: (a) different aspects 
of behavior are being measured in these experi- 
ments, or (b) the validity of the Rorschach in- 
dices may be questionable, or both. 


Lazarus, Deese, and Osler [11] and Deese 
and Lazarus [7] have presented a summary 
of the literature on the effects of psychological 
stress upon performance, including personality 
correlates of behavior under stress. Both re- 
views present numerous studies of performance 
under stress in which the Rorschach test, as 
well as other measures of personality, have been 
utilized. The authors conclude that the major- 
ity of ‘these investigations report either nega- 
tive findings or else present correlations which 
are statistically significant but are too small 
to be of any practical value. 


Purpose and Hypotheses 


The purpose of this study was to investi- 
gate the relationship between certain Rorschach 
measures, presumably concerned with intellec- 
tual and emotional control, and performance 
under two types of stress situations designated 
as failure stress and task-induced stress (ex- 
perimental distraction). It was an attempt to 


examine experimentally the validity of the 


11 


claim made by Rorschach-workers, on the basis 
of sclinical experience arid experimentation, 
that certain Rorschach variables indicate how 
vulnerable an individual is to stress. 

In a previous study, Stopol? found that 
resistance to failure stress was independent of 


3Stopol, M. S. The 


v consistency of stress tolerance. 
To be published. i 
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task-induced stress tolerance. Moreover, a cum- 
ulative effect of stress was reported from one 
session to the next, regardless of the type used. 
Furthermore, no difference was found be- 
tween the effects of failure stress and experi- 
mental distraction if the temporal sequence of 
presentation of the type of stress was control- 
led. Consequently, the Rorschach hypotheses 
under consideration were applied to each type 
of stress situation separately. 


General hypothesis. The Rorschach test is 
able to differentiate individuals more able to 
tolerate and individuals less able to tolerate 
(a) experimentally induced failure stress and 
(4) task-induced stress (experimental distrac- 
tion). 

Specific hypotheses.s The following specific 
hypotheses were tested: 


1. The greater the amount of Z, the greater the 
tolerance for stress. 


2. Individuals with R between 25 and 50 will 
be more able to tolerate stress than individuals out- 
side that range. 


3. Individuals with F% between 25 and 50 will 


be more able to tolerate stress than individuals out- 


side that range. 


4. Individuals with F+% between 69 and 89 
will be more able to tolerate stress than individuals 
outside that range. 


5. The higher the F+% on the color cards, the 
Sreater the tolerance for stress. 


6. The greater the preponderance of FC over CF 
“+ C, the greater the tolerance for stress. 

7. The greater the preponderance of form-domi- 
nant responses over form-subordinate responses, the 
greater the tolerance for stress. 

8. The fewer the number of color shock signs, 
the greater the tolerance for stress. 

9. Individuals with Av. T/1R between 9 sec. 


and 16 sec. will be more able to tolerate stress than 
individuals outside that range. 


10. The higher the mean rank based on a combi- | 


nation of low W’%, high D4%, and the number of 
form-dominant responses greater than form-subor- 
dinate responses, the greater the tolerance for stress. 

11. Individuals who show a coarctative or extra- 

tensive pattern will perform less well under stress 
than individuals who show ar introversive or ambi- 
equal pattern, 

12. The greater the number of Davidson’s [5] 
“signs of effective adjustment, the greater tk2 toler- 
ance for stress. 

4A detailed description of the criteria used in 
scoring the various Rorschach measures under con- 
sideration may be found in the original report [14]. 


Murray S. Siopol 


The specific hypotheses used in this study 
stem from three sources, The variables used 
in hypotheses 1, 2, and 9 were suggested by 
Williams [19]. Hypotheses 3, 4, 6, 10, and 
11 were largely based on the results of previ- 
ous investigators [2, 10, 13, 15, 16, 19] who 
found one or another of the particular measures 
in question significantly related to performance 
under various types of stress conditions. Hy- 
potheses 5, 7, 8, and 12, on the other hand, 
were derived from clinical experience. In gens 
eral, the Rorschach factors under investigation 
are supposedly related to intellectual and emo- 
tional control, the necessary characteristics pre- 
sumably involved in the adequate funccioning 
of an individual in a stress situation. 
ai 

Method 

A detailed description of the method is gv 
en in a previous paper® and the origina” 
report [14]. The Rorschach test, admin 
istered according to the directions outlined by 
Beck [3], and a series of five Wechsler-Belle 
vue Form II Digit-Symbol Test (DST) (17) 
practice trials were administered to 48 malt 
Columbia University students during the firs 
session of the experiment. The second sessio 
which took place within 24 to 48 hours alt 
the first, consisted of two periods of tirg 
phases each. During the first period in Phas 
a, each § was given 10 DST trials under on 
timal conditions. In Phase 4, either failu" 
stress or experimental Wistraction was adminis 
tered during five of the 10 trials. Phase ¢ wa 
a poststress phase where no stress was induce! dl 
during a block .of eight trials. The secor 
period began after a 15-minute interval. E4¢ 
S underwent a procedure similar to the fis 
period except that a different form of stre” 
was induced. Two types of stress conditio” ý 
were utilized: (a) failure stress, which con 
sisted of a series of admonishing and reprovi”? 
comments strongly implying disapproval of pe 
formance, and (b) task-induced stress or €”. 
perimental distraction, which involved a se, 
of bells, a buzzer, and a flashing light wh!” 
were presented during a given DST trial. 

The stress score utilized was the degree 
change in performane> on the DST during * { 
Stress trials as compared to prestress leve 


See footnote 3, 
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functioning within each period. This score was 
calculated from the mean of the last five pre- 
Stress trials minus the mean of the five stress 
trials, divided by the range of the last five pre- 
Stress trials. d 


o 


Results 


Before reporting the actual results, a word 
might be in order concerning the statistical 
techniques used in testing the hypotheses. The 
method of rank-order correlation was used in 
testing hypotheses 1, 5, 6, 7, and 10. The chi- 


‘Square method was applied in the remaining 


hypotheses, For hypotheses 8 and 12, chi square 
Was used rather than rank-order correlation be- 
Cause of the narrow range of scores as well as 
the presence of many ties. The cut-off point 
Wks made as near the median as possible. A 


Single-tailed test of significance was used in all 
instances, 


ii m applying the chi-square test to the data 
the 's study, it was noted and anticipated that 
me cell frequencies would be rather 
cal i It was therefore planned beforehand to 
Rei ate the > values of chi square by Fisher s 
to Ct method if an obtaihed value of chi square, 
“tected for continuity, was in the predicted 
ii tion and had a value of .10 or less. This 
in line with Edwards’ [8] suggestion. 
vaio, check on the scoring reliability of the 
eve ous Rorschach factors used in this study, 
R ty third protocol was given to a qualified 
‘rschach examinet fer independent scoring.° 
;_ € total number of responses scored was 677, 


i*nvolving 779 determinants. Both main and ad- 


_ Sa 


tional 


reli responses were tabulated. The scoring 
1 


no ability for all measures was extremely high, 
Ti. ee of agreement falling below a 
the li may readily consider the scoring © 
Ughly reliable, 
inden Purposes of analysis, Ss having task- 
Stree ores initially, followed „by failure 
havi, will be referred to as Group A. The Ss 
inte failure stress initially, followed by task- 
ro ed stress will be called Group B. Since 
uP A was found to be significantly different 
The 
Kurlan, 
en; y 
the 


Writer would like to thank Dr. Shabse H. 

Sco; Who so gene-ourly consented to independ- 

ee the Rorschack protocols. Prior to giving 

es mols to Dr, Kurland, various scoring 

Tecords 0M both Beck [3] ard the remaining 32 
e Were discussed ia detail. 

o 


Orschach protocols in this study to be 
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from Group B as a result of the cumulative 
effect of stress, regardless of the type used,7 
each group was necessarily treated sepa- 
rately. 

For Group A, no significant relationship 
was found between any of the hypothesized 
Rorschach variables and resistance to either 
failure stress or experimental distraction. 

For Group B, the only significant relation- 
ship found was between the combination of 
low 17%, high Dd9, and a greater number 
of form-dominant than form-subordinate re- 
sponses and the ability to withstand both fail- 
ure stress and experimental distraction. The 
rank-order correlation coefficients were .37 and 
.47 respectively. Both coefficients are signifi- 
cantly different from zero beyond the .05 level 
using a one-tailed test. This Rorschach measure 
was taken literally from Waldman [15, 16] 
who found this combination to differentiate 
“slow” from “rapid” learners under stress. The 
score was obtained by taking the mean rank 
of each person on each factor in the combina- 
tion. Thus, an individual who was ranked low 
on two factors and extremely high in another 
may be above the median when these three 
factors are averaged. It is, therefore, some- 
what misleading, if not hazardous, to general- 
ize about a combination of low W%, high 
Dd and a greater number of form-domi- 
nant over form-subordinate responses. The le- 
gitimacy or justification of using such a meas- 
ure may thus be seriously questioned. In ex- 
amining the data further, if we classify each 
person on the basis of being above or below 
the median value in 7%, Dd%, and form- 
dominant greater than form-subordinate re- 
sponses, in Group B seven out of 24 Ss showed 
all three signs in the predicted direction; in 
Group A only six Ss presented all three signs in 
combination. Of the six Ss in Group A, none 
was above the median value for task-induced 
stress tolerance ; three cases were above the me- 
dian value for failure stress tolerance. Of the 
seyen Ss in Group R, four.were above the medi- 
an value for both failure stress and task-induced 
stress tolerance. It appears obvious that this 
hypothesis fails to hold when subjected to a 
more stringent and meaningful zest. Because 
of the vagueness of the proposed criteria, and 
since this hypothesis was not tenable for Group 

7See footnote 3. _ 
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A, it is highly possible that the significant cor- 
relations obtained with Group B may reflect 
only chance factors. Furthermore, this sugges- 
tion is reinforced when we consider that the 
probability of obtaining two significant corre- 
lations at the .05 level by chance when 24 
tests of significance are calculated is .34 [18]. 
Thus we may conclude that the Rorschach test 
as used in this study is of no value in predict- 
ing efficiency of performance under conditions 
of failure and experimental distraction. 


Discussion 


Only one Rorschach measure, a combination 
of iow Wg, high Dd%, and a greater num- 
ber of form-dominant over form-subordinate 
responses, was found to be associated with the 
ability to withstand both failure stress and ex- 
perimental distraction if failure stress was fol- 
lowed by experimental distraction. The diff- 
culty of testing this measure and the vague- 
ness of this combination were noted. A more 
appropriate statistical analysis found these 
factors to have no diagnostic utility, since they 
could have resulted from chance. Therefore, 
for all practical purposes, it may be said that 
no Rorschach modality was consistently found 


to be associated with behavior under either 
type of stress situation, 


Failure to obtain significant Positive Cesults 


with those Rorschach factors allegedly re- 
lated to stress tolerance is open to several in- 
terpretations. One Possibility is that these par- 
ticular Rorschach measures possess no utility as 
predictors of failure stress or task-induced 
Stress tolerance. The previous investigators 
who did find significant relationships may 
simply have been capitalizing on chance fac- 
tors. It may also be Possible that the Ror- 
schach is able to differentiate between persons 
with respect to tolerance for a given stress, but 
by measures other than those hypothesized in 
this investigation. Another possibility may be 
that these Rorschach signs are not sensitive 
enough to discriminate between individuals 
subjected to an experinientally induced stress 
which is probably not as severe or complex as 
“some extra-laboratory stresses of a longer dura- 
tion. Still another possibility may be that the 
results are a function of the Ss investigated. It 
should be fnrther noted that the kinds of be- 
havior which these Rorschach factors are at- 
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tempting to pvedict may not be sufficiently uni- 
tary to be predictable by an instrument such as 
the Rorschach, and especially by the so-called 
“sign approach.” If we may speculate, the 7 
ter possibility appears to be the most feasi 
of those suggested. It has been clearly demon 
strated that a person's tolerance for stress, t0 
a large extent, depends upon both the quality 
of the particular stressful stimulus condition 
to which he is exposed’ and the type O% 
motivation mobilized in a particular type 0*4 
stress situation [7, 11]. Furthermore, Sherman 
and Bell [12] suggest that tolerance for a giv 
en stress may be a function of many conditions 
If this is the case, stress tolerance may’ be re 
garded as a complex phenomenon, nonunitary 
in nature. Moreover, prediction of such behav’) 
ior seems almost impossible in terms of a one | 
to-one relationship with other variables, as wa 
the situation in this investigation. Neverthe- 
less, having no logical basis for selecting any © 

these possibilities as holding true, we must rd 
gard these results as indicating that a number 
of Rorschach signs presumably associated wit | 
resistance to stress fail to meet this partieulat 
test of experimental validation. 


F | 
Summary and Conclusions 


PaP | 

The purpose of this study was to determi 
whether certain measures derived from ay 
Rorschach test were able to predict the abilitY 
of persons to withstand two distinct types A 
stress conditions designated as failure bae 
and task-induced stress (experimental distra“ 
tion). A series of 12 hypotheses was evolved; 
The Rorschach test and a series of Digs 
Symbol Test trials were given to a group 
48 Ss in two sessions. The second session ©” 
sisted of two Periods, each involving a PT 
Stress, a stress, and a poststress phase. Twent! 
four Ss received failure stress initially, follow’, 
by task-induced stress, while 24 Ss experienc? 
task-induced stress initially, followed ‘by £” 
ure stress, sol 
Except for a combination of low W%, We, 
Da%, and a greater number of form-domin™ ;- 


. a } 
over form-subordinate responses, which oth 
correlated with the ability to withstand > if 
failure str 


: ess and experimentai distractio” i5 
failure str 


traction, no specific Rorschach mezsure ™ 


®See footnote 3, | 
| 
| 


à ; | 
ess was follov-ed by experimental ae 


a 
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found to be significantly related to the ability 
to resist either type of stress situation. It was 
shown that the one significant relationship 
Probably reflected chance factors, since the 
Probability of obtaining two statistics signifi- 
cant at the .05 level by chance when 24 hy- 
Potheses are tested is .34. It may therefore be 
concluded that the Rorschach factors employed 
in this study are of no value in predicting effi- 
ciency of behavior under conditions of failure 
Stress or task-induced stress. 


Received May 29, 1953. 
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Age, Sex, and the Manifest Anxiety Test” 


A. W. 


o 


Bendig 


University of Pittsburgh 


A shortened (50-item) form of Taylor's 
Manifest Anxiety Scale [1] was given to 497 
students enrolled in undergraduate psychology 
courses. The Ss also recorded their sex and 
age on their answer sheets. Raw MAS scores 
were converted to normalized McCall T scores 
for the subsequent analysis. The Ss were di- 
vided into seven age groups and two sex groups 
and their scores analyzed by an analysis of vari- 
ance. Mean MAS scores were also computed 
for each age and sex group for inspection for 
trends. Finally, a critical ratio was computed 
between the mean MAS scores of the Iowa [1] 
and Pittsburgh samples and an F ratio com- 

puted from their variances, 


_Analysis of variance showed no significant 
differences (at the .05 level) between the sex 
or the age groups, nor was the sex-age interac- 
tion term significant. While there was_not a 
significant difference between the mean MAS 
scores of men and women subjects, women 
show slightly higher mean MAS scores in six 
oF the seven age groups represented. A slight 
curvilinear (parabolic) relationship between 
MAS and age can be noted for the men witha 
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> Y y 
peak occurring in the 23-25 year age group. 
This slight curvilinearity is not apparent for 
women, 


A comparison of the mean aai 
MAS scores for the Iowa and Pittsburgh 
samples gave a critical ratio of 2.73 which is 
significant at the .01 level. The F ratio between 
the variances of the two samples was 1.11 
which is not at all significant. However, the 
difference between the two means was very 
small. 

Apparently, scores on the Manifest Anxiety 
Scale are not related to sex differences or to 
age differences over the range represented by 
our sample of college, students. Selecting: stu- 
dents on the basis of extreme MAS scores, 
which is commonly done in comparing the 
learning rate of “anxious” and “nonanxious” 
subjects, does not introduce age or sex differ- 
ences between the subjects comprising the two 
groups. The significant difference between the 
mean MAS scores of the Iowa and Pittsburgh 
samples may be attributed to population dif- 
ferences. Apparently college students demon- 
strate significantly less manifest anxiety ae 
Pittsburgh than they do at Iowa although the ~ | 
magnitude of this difference is small. i 
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d oe of the present study was to in- 
Bots ande 1e valini of some of the assump- 
the RY a _ the clinical interpretation of 
Baral eit white space response (8). In 
Positional Te a voluminous clinical and ex- 
Brichach iterature, the basic principles of 
jected to a ca have not been sub- 
been S examination, and there have 
Perimental e ;, few attempts àt systematic ex- 
of the s validation [2, 15]. This is as true 
Scoring ¢ response as it is of the other major 

ategories. 


oe fairly extensive agreement among 
cal values ie concerning the psychologi- 
iS assum i o be assigned to the S response. It 
” ed to reflect some sort of “opposition- 
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tend ] 
Schach ency on the part of the subject. Ror- 


Several 
Possible 


tradition holds further that there are 
ae of overt behavioral expression 
€ type of this inferred oppositional tendency, 
. basic rites expression being determined by the 
tion jg ener configuration. This configura- 
Versione wy defined in terms of the intro- 
SPonses o Toversion continuum. If the S re- 
Pattern aoa in an extratensive personality 
e environ, opposition will be directed against 
ring] a e resulting in behavior charac- 
f on istig” tnd «, assertive,” “stubborn, 
| ersive pers defiant.” If they occur in an intro- 
be directed onality pattern, the opposition will 
in be Moree against the self, resulting 
Ings,” uself characterized as “inadequacy feel- 
Self-distrust,” and “self-criticism.” In 
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“Oppositional” Behavior’ 


Albert Bandura 


State University of Lowa? 


an ambiequal personality pattern, the § re- 
sponses indicate that the oppositional trend 
will be expressed in behavior characterized as 
“ambivalent tendencies” or “indecision.” 


Validation studies concerned primarily with the 
S response are for the most part lacking. A review 
of the available evidence on the relationship be- 
tween the S response and oppositional behavior ten- 
dencies reveals some contradictory findings. A num- 
ber of studies have reported a positive relationship 
between the occurrence of S responses and antiso- 
cial behavior [3, 12, 16]. However, these studies 
present some serious methodological defects, and 
none includes a comparison with an adequate con- 
trol group. On the other hand, Endacott’s [6] study, 
in which delinquent boys were compared with sev 
eral normal control groups failed to show any 
significant differences among the groups in the fre- 
quency of occurrence of S responses. Two studies 
specifically designed to evaluate the validity of the 
S response [7, 10] have recently been reported. The 
findings of both were essentially negative. However, 
the adequacy of some of the criterion measures used 
in these studies is rather questionable, In summary, 
the validity of current interpretations of the S re- 
sponse is still to be established. 

Statement of the Problem 


The present investigation is concerned with 
the validity of the inferences drawn from the 
S response as reflecting an “oppositional” tend- 
ency. Teachers’ ratings were used as the in- 
dependent criterion measure against which to 
evaluate the Rorschach hypotheses. The specific 
hypotheses subjected to empirical test were: 

a. A significant and positive relationship 
exists between the numbér of S responses and 
ratings of “negativism” in extratensive osub- 
jects. z 

b. A significant and positive relationship 
exists between the number of S responses and 
ratings of “inadequacy” in introversive sub- 
jects. i 
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c. There is no systematic relationship 
between ratings of “inadequacy” and the num- 
ber of S responses in extratensive subjects and, 
similarly, there is no systematic relationship be- 
tween ratings of “negativism” and the number 
of S responses in introversive subjects. 


Method 


Subjects. A total of 81 University of Iowa 
High School students, of whom 33 were fe- 
males and 48 were males, served as subjects 
(Ss). They ranged in age from 13 to 18 years, 
the median age being 15 years. 

Procedure. The Ss were tested individually. 
The Rorschach administration differed from 
the conventional technique only with respect 
to length of exposure time. While in the stand- 
ard procedure S is usually permitted to look 
at the cards for as long or short a time as he 
desires, in this experiment each § was required 
to look at each card for a four-minute period. 
The Rorschach inquiry was conducted in the 
conventional manner, i.e., immediately after 
the S$ had given his response to all ten of the 

_ cards. 

Rorschach scoring procedure. The Ror- 
schach records were scored according to the 
scoring system of Hertz. In computing the § 
score, primary space responses were counted as 
1 and secondary space responses were c€unted 
as .5. The color and movement responses were 
used to determine the experience types which 
were defined as follows: 

Extratensive: 2C>M 

Ambiequal: 2=C=M 

Introversive: M>ZC 
The Rorschach ex 


Perience-type classification 
was used 


versive Ss, who gave a five- 
and rejected six of the carı 
from the final analysis. Th 
value for the extratensive 
while the average 3C.1¢ 
versive group was 1.9:3,6, 


response protocol 
ds, was excluded 
e average TC :14 
group was 6.2:1,6 
value for the intro- 


Rating procedures. Five teachers rated the 
59 Ss on four personality variables, viz., nega- 
tivism, assertiveness, inadequacy feelings, and 
self-distrust. In terms of the statements in the 
Rorschach literature, the first two personality 
characteristics would reflect the behavioral ex- 
pression of S responses in an extratensive pat- 
tern, whereas the last two would reflect the 
behavioral expression of S responses in an in- 
troversive pattern. Each personality variable 
was represented on a graphic rating scale by 


varying degrees of the behavior being rated. 
Simple descriptions of observable behavior 
were used, and the maximal rating was-placed 
sometimes to the right and sometimes to the 
left in order to minimize a possible response 
tendency on the part of the rater to place S 
in the same category in each of the ratings. The 
number of Ss rated by any one teacher varied 
as follows: 57, 47, 40, 33, and 11. Fifty-four 
of the 59 Ss were rated by at least three or 
four teachers. The remaining five Ss received 
two ratings. 

The rating procedure consisted of a modified 
rank-order method. Each rater was presented 
with a pile of cards containing the names of 
the Ss he could rate. The first step was to sort 
these cards into five consecutive piles, each 
pile describing a degree of the behavior being 
rated. Having done this, the teacher then 
ranked the names within the piles thus pro- 
viding a final rank order for the group. A rank 
of 1 was regarded as the highest in the series, 
i.e., was assigned to the $ who was considered. 
Most negativistic, most assertive, most in 
quate, or most unsure of himself. 

The assigned ranks were converted into 
scale values on the base line of the normal 
curve by Hull’s method [9]. The numerical 
values obtained from the rank data constituted 
the operational definition of these personality 
variables. The mean value for each § on each 
of the personality variables was computed to 
give a final composite score which was used to 
evaluate the Rorschach hypotheses, 
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Results 


Reliability of the S score and ratings. Since 
the distribution of $ sponses over the first 


five cards (51%) was found to be co: 
to the distribution over the last oo 


five successive descriptive statements indicating “¥ 


ve cards | 
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(49%), the split-half technique was employed 
in estimatifig the reliability of the S response. 
The correlation between the two halves was 
found to be .72. The estimate of reliability 
of the whole test, as determined by the use of 
the Spearman-Brown formula, was .84. The 
magnitude of this correlation shows the S re- 
sponse to be a consistent response tendency. 
. The reliability of the ratings was estimated 
ri the use of an analysis of varjance technique 
hel Ate sets of ratings, as described by 
me ]. The size of the obtained reliability 
com — (negativism, r= 83; assertive- 
self a 79 ; inadequacy feelings, r = 715 
site rust, r = .81) reflects considerable con- 
y among the teachers’ ratings. 
sIntercorrelation of the ratings. Of the four 


“personality vari fee 
onality variables rated, negativism and as- 


Ses were designed to reflect the be- 
Nestea expression of S responses in an ex- 
self-dictr, pattern while the inadequacy and 
the eae ratings were designed to reflect 
Versive avioral expression of § in the intro- 
raite Fie as assumed in the Rorschach 
sonality Ri he relatiorship between these per- 
study at. aracteristics, as measured in this 
ment co as estimated by means of product-mo- 
rrelations. 
i fairly high and positive relationship (r= 
à eee Was obtained between ratings of in- 
ese ik and self-distrust, which suggests that 
related o përsoni characteristics are closely 
in the fe ess definite relationship is revealed 
ism and rrelation between ratings of negativ- 
Were iny assertiveness (r =+ .32). There 
assertive erse relationships between ratings © 
ness and self-distrust (r = 7 
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ism seem to be relatively independent of in- 
adequacy feelings (r = + .10) or self-dis- 
trust (r = + .04). In general, the size of the 
intercorrelations among the ratings is contra- 
indicative of the existence of much “halo” ef- 
fect. 

Relationship of S responses to personality 
ratings. In testing the hypotheses with respect 
to the behavioral inferences drawn from the $ 
response, product-moment correlations were 
calculated between the S scores and the aver- 
age ratings of negativism, assertiveness, self- 
distrust, and inadequacy feelings for the two 
Rorschach experience types- Since the distribu- 
tion of S scores departed from normality in the 
direction of positive skewness, the VX + 5 
transformation was employed and the correla- 
tions were run on the transformed data. The 
results of this analysis are shown in Table 1. 


The negativism ratings and the S scores in 
the extratensive and introversive groups corre- 
lated + .27 and + 44 respectively. Assertive- 
ness was found to be correlated + .26 with S 
scores in the extratensive group and + .13 in 
the introversive group- No relationship was re 
vealed in the correlation of + .02 between in- 
adequacy feelings and the S scores in the ex- 
tratensive group and 09 between these 
measpyres in the introversive group. An inverse 
relationship was found between ratings of self- 
distrust and S scores in both the extratensive 
group (—.23) and the introversive group 
(— .30). 

A Z’ transformation was used to test the 
significance of the differences between the cor- 
relation coefficients in the two experience 
types for the different behavior ratings. In no 


and : A 
feelin etween assertiveness and inadequacy case did the values of r differ significantly be- 
gs (r = — .45), The ratings of negativ- tween the two experience types. Since the hy- 
Table 1 
Table of Correlations between S Scores and the Personality Ratings 
for the Total Sample and for Two Rorschach Experience Types 
Rating „Experience type 3 Weighted © ‘ eet 
s Fa a ja! 
Extratensive Introversive average RS adain 
tivis 
Assertiver 427 +44 4.35 E 
po | f j AS ae 
Tadig Ce +.2€ +.13 4.20 im i 
Self-distrust +.02 +.09 +.05 —12 418 
—.23 —-30 —.26 ; : 
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Sigan 
fica; 
, nt at the .01 leval. 
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pothesis that the two correlation coefficients 
for each behavior rating were obtained from a 
common population is tenable, the weighted 
average of these correlations was obtained by 
averaging the corresponding Z’ values. The 
correlation coefficients based upon the com- 
bined data show the following relationships 
between the § scores and the ratings: negativ- 
ism, r = + .35; assertiveness, r = + .20; in- 
adequacy, r = + .05; self-distrust, r = — .26. 
In the group of 59 Ss, S and R minus S 
were found to be closely correlated (r = + 
-67). The degree of relationship between R 
minus $ and the ratings is also shown in Table 
1. The highest correlation was obtained be- 
tween R minus S and self-distrust (r =- 
-31), indicating that Ss who are judged to be 
relatively self-confident tend to give many re- 
sponses. The partial correlation technique was 
used to determine the correlation between the 
S score and the ratings with the influence of 
differences in total responsiveness held con- 
stant. The resulting partial correlations 
showed the following relationships: negativ- 
araism, r = + 34; assertiveness, r = + .14; in- 
adequacy, r= + .18; self-distrust, r = — .07. 
Since a Prediction can be made concerning the 
Probable direction of the correlation, a single- 
tailed test of significance was used. None of 
the last three values of 7 met the criterion of 
significance at the .05 confidence level. The 
correlation coefficient of + .34 between $ and 
negativism was significant at the .01 confidence 
level, which indicates a significant but slight 
tween an individual’s tendency 

to give § responses to the Rorschach and a 


tendency toward negativistic behavior, as rated 
by his teachers. 


Discussion 


It has been customary in Rorschach work to 


type classification as a 
the Interpretation of the 
S response. Examination of the correlation co- 


e © ratings and the § scores 
i fà 
in the two experience types shows no evidence 


to support the Rorschach hypothesis that tFe 
type of behavior to be predicted from the § 
response is dependent on the experience type 
in which the S response occurs, The differences 
between the correlation coefficients of § score 
and the ratings in the in 


Albert Bandura 


troversive group and - 


the correlations of S score and these ratings in 
the extratensive group were small‘ and statis- 
tically insignificant. This finding has obvious 
implications for clinical diagnostic work. 
The practice of interpreting the behavioral sig- 
nificance of the S score in terms of experience 
type deserves to be discontinued until cogent 
evidence for its justification becomes available. 

The obtained positive relationship between 
the frequency of S responses and ratings of 


negativistic behavior offers some support for . 


the Rorschach assumption that the S response 
represents an oppositional behavior tendency- 
It is obvious, however, from the moderate size 
of the obtained relationship that the contri- 
bution of the S response, taken singly, to the 
prediction of negativistic behavior would be 
relatively small. Perhaps, if combined with 
other Rorschach factors which provide addi- 
tional valid variance, consideration of the S 
response would add to the effectiveness of the 
Rorschach in predicting negativistic behavior 
tendencies. 

The failure to secure positive findings with 
respect to the relationships between the € re- 
sponse and ratings of assertiveness, self-dis- 
trust, and inadequacy feelings could be con- 
servatively interpreted as being merely a failure 
to disprove the null hypothesis, given the par- 
ticular conditions of the present experiment. 
Such a conservative interpretation rests on the 
assumption that, in contrast to negativism, at- 
titudes of inadequacy arid self-distrust are more 
difficult to evaluate and consequently were not | 
validly measured by the teachers’ ratings 
However, it may be pointed out that the 
teachers rated the Ss in terms of observable be- 
havior, rather than of their own conceptions © 
the trait being rated, and that the behavioral 


“descriptions were of the type commonly sub- 


sumed under these trait classifications. It oe 
be further pointed out that the reliabilities o 


ic 


a- 


l 


the teachers’ ratings of these traits were aS~ 


high as the reliability of the ratings of negativ- 
ism. This, of course, does not assure validity 
of the ratings, but does at least indicate that 
there was consistency in the teachers’ estimates 
of the behaviors assumed to be representativ? 
of these-trait classifications. With these con- 
siderations in mind, a'stronger interpretatio” 
of the findings seems warranted, viz., there 3 
no evidential basis for the Practice of inferring s 
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such traits from the occurrenc> of the § re- 
sponse, ang the practice should be discontinued 
until such evidence is forthcoming. 


+ p] 
» Summary 


The present investigation was designed to 
Study the validity of the inferences drawn 
from the Rorschach white space response as 
reflecting an oppositional tendency. 

Eighty-one University of Iowa High School 
Students were tested individually with the Ror- 
ni test. Ratings on 59 of the Ss, 27 of 
i m presented introversive and 32 of whom 

sented extratensive experience types, were 
a by five teachers with respect to negativ- 
wae es; inadequacy feelings, and 

a trust. These ratings served as the in- 
i ri criterion measures against which the 
Schach hypotheses were tested. 


T ; 
he results obtained were as follows: 

Dems influence of the experience type on 

Se of the relationship between the S 


ithout reference to experience type, 
a of S responses showed a significant- 
© ratin e relationship of moderate degree to 
igs of negativism. 
Seika reference to experience type, no 
è hee relationship was obtained between 
‘ertivene veel f S responses and ratings of as- 
trust, ss, inadequacy feelings, and self-dis- 
° o 
pion the findings it was concluded that: 
ae usefulness of the Rorschach expe- 
of the pe classification in the interpretation 
1S felt ere remains unsubstantiated. It 
De as m the utilization of the experience 
tion of th ifferential factor in the interpreta- 
Until ev. 8 Tesponse should be discontinued 
available, ence for its justification becomes 
Ber te finding of a significant zelationship 
the ¢ > matings of negativistic behavior and 
lon ae onse represents a partial corrobora- 
Sp the Rorschach hypothesis of the S re- 


nse « =a 
© as reflecting an oppositional tendency. 


ferrin ee there is no evidential basis for in- 
inadequacy rr self-distrust® feelings 


the num 


nse and the behavior ratings was observed. ` 


from the S response, it is felt that this practice 
also should be discontinued until such evidence 
is forthcoming. 
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Acceptance of Self as Measured by Interviews 
and the Index of Adjustment and Values' 


Robert E. Bills 


University of Kentucky 


Several studies have described the reliability 
and validity of the Index of Adjustment and 
Values [1, 4], its ability to differentiate 
Personality types [2], and its usefulness as a 
research tool [3]. In order to relate research 
findings on the Index to the larger body of re- 
search concerning “acceptance of self” as an 
important personality variable, it should be es- 
tablished that acceptance of self as measured by 


the Index and by interviews are essentially the 
same. 


Verbatim transcriptions of recorded, 30- 
minute, open-ended interviews were collected 
from 13 people. Five of the subjects, all male, 
were graduate students in educational ad- 
ministration, and eight, six male and two fe- 
male, were public school administrators. 

The subject’s total response between ty7o in- 
terviewer responses was accepted as the unit 
to be scored, and the responses were classified 
according to content and attitude. Statements 
were classified according to self, others, work, 
environment in general, and unclassifiable, and 
type of attitude (positive, negative, and neu- 
tral). Ambivalent statements were scored once 
for plus and once for minus if neither the 
Positive nor the negative aspects appeared pre- 
dominant, but if either the positive or negative 
aspects were stronger, then that aspect was 
given an additional score of plus or minus. 

Two judges, working independently of each 
other, scored all the interviews. Agreement be- 


+The data for this study we collected as part of 
a larger study in the improvement of educatidnal 
administration sponsored by the W. K. Kellogg 
Foundation. The University of Kentucky ; roject 
is directed by Robert L. Hopper, Director of the 
Bureau of School Services. The writer would like 
to express his thanks to Henry Oppenheim who has 
assisted with the project and helped score the in- 
terview material. 
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tween judges was determined by checking the 
scoring of each item and noting the number of 
agreements and disagreements. The percent- 
ages of agreement between the judges were 
69, 70, 67, 71, 80, 68, 69, 59, 70, 70, 76, 77, 
and 63, which are satisfactory for the purpos’s 
of this study. i 

When the judges disagreed on the scoring 
they discussed the difference and arrived at 2 
decision regarding the unit. The revised scor- 
ing was used to determine acceptance of self 
which was calculated from the formula: num- 
ber of positive attitudes toward self divided by 
the total of the positive and negative attitudes 
toward self, 

Subjects were ranked according to accept- 
ance of self shown by the interview material 
and the Index of Adjustment and Values, and 
the ranks were correlated to give a rho of .84, 
which is significantly different from zero at 
less than the .01 level and which permits the 
conclusion that what a subject says about him- 
self in an interview corresponds highly with 
the ratings he gives himself on the Index of 
Adjustment and Values. j 
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Prediċtion of Aggression from the Rorschach 


Winifred Ingram 


> e 
P a . . 
he prevailing need for experimental vali- 


Faas the Rorschach prompted the investiga- 
the S a here. Ir is an attempt to aimas 

j Ra roy of the Rorschach as a measure o 
A tues ne with specific reference to the white- 
i *exberj €sponse, by predicting behavior in an 
| ee situation. The precision of an ex- 
a ii with the Rorschach may be consider- 
Owered when the entire test is the basis 

ee Predictions, since many of the scores 
Not in into the whole interpretation have 
hat iy verified. However, it has been shown 
Single ai Sreater precision is secured by using 
een be Composite scores. Rather, success has 
Was te more often where the total test 
tion of ; [3]. It is recognized that an evalua- 
fect 'solated scores or interpretations 1s, 1N 
r er evaluation of the whole test. More- 
Orecast is apparent that it is not possible = 
r o scores can be held accountable 
Tor an errors when other sources © 
ated, can be*controlled have been elim- 
2 “OnCrete Bs prediction of actual behavior ity 
’Mong io presents many difficulties ; 
of actual i major problems are the definition 
the forecs ehavior and concrete situation [7], 
ted ries of expected behavior, the time 

© the experiment and its analysis, 


er 


allot 
13] 
5 
Ware a experimenter must be particularly 
Sion, the usual cultural modes of expres- 
| j hipaa the socialized indiyidual will 
ther thas to utilize these forms of behavior ra- 
ca n some more highly individualized acts. 
Ove factors were given major attention 1n 


Noy , 
ichigy the Neuropsychictric Institute, University 
T an. The author wishes to express gratitude 
Criticism, Richards for his valuable seggestions 
TS S in the preparation of this study and 

ithey ` Zeigler, R. D. Rabinovitch, and Mrs. 
! man? who read this manuscript and sug- 


n 
Y helpful revisions. 


the number and kind of procedures used 


Northavestern University? 


the planning of this experiment and the anal- 
ysis of the results. 

Rorschach states that “S answers always in- 
dicate some sort of tendency to opposition” 
[6, p. 39]. Beck’s interpretation in general ad- 
heres to this formulation, but he has added 
some nuances to the scoring and interpreta- 
tions. Particularly, the delineation of “uni- 
tary reactions” and “true reversals of figure 
and ground” implies a suggestion of varying 
personality reactions. Depending upon the con- 
figuration of the entire test, Beck has applied 
the adjectives obstinate, skeptical, ambivalent, 
and compulsive to those persons responding 
with a certain amount and kind of § response 
[1, pp. 52-57; 2]. These traits have been re- 
ported to accompany or follow frustration by 
the many investigators who have experimented 
with @he frustration-aggression hypothesis, and 
it seems well established now that aggression 
is a major reaction to frustration. If § is an 
indicator of aggressive tendencies, individuals 
with an average or above average S score 
should respond to a situation which is frustrat- 
ing to them with more aggressive behavior, 
quantitatively and qualitatively, than individ- 
uals who do not produce S. To test this hy- 
pothesis it was proposed to predict the aggres- 
sive behavior expected from two groups dif- 
ferentiated on the basis of the number of § re- 
sponses produced. The standard for the quan- 
tity of S was adopted from Beck, who states 
“Tn most healthy individuals a minimum num- 
ber of S percepts — from. two to four — will 
be found” [3, p. 47], and Molish, who found 
the mean number of S in normal subjects to be 
betwetn zero and four.” 7 


For the purposes of this study aggression is 


2Personal communication from Dr, Herman Mo- 
lish, research psychologist, Psychology Laboratory, 
Michael Reese Hospital, Chicage, Illinois. 
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viewed as a dimension with socially acceptable 
behavior at one extreme and socially unaccept- 
able behavior at the other. F. rom among the 
` adjectives used by Beck and Rorschach to de- 
scribe the characteristics of the trait projected 
in S and the terms used to specify aggressive be- 
havior by the frustration-aggression theorists, 
the following were selected as most representa- 
tive of the trait under consideration: self-asser- 
tion, initiative, Persistence, resistance, and hos- 
tility. The first three were presumed to repre- 
Sent socially acceptable behavior and the last 
two were considered to belong in the category 
of socially unacceptable behavior. In addition to 
these five aspects of aggression, two terms, co- 
Operation and rapport, were selected as repre- 
senting the opposite of aggression. Operational 
definitions, an example of which is given be- 
low, were derived from observations of behav- 
ior in pilot runs of one of the situations, re- 
Ports of behavior in frustration experiments 
[11], and familiarity with interviewee behay- 
ior. Each set of Operations is preceded by dic- 
tionary definitions [9]. 


za Assertion 
1. the maintaining or defending, as a cause or 
claim. 
2. positive declaration or averment, affirmation; 
statement asserted; position advanced, a 


Operation Interview 
opinion or attitude about himself in the 
sing opinions, 

_ 4% Positively by affirming his position, demonstrat- 
ing or illustrating his position or ability. 
b, negatively by denying the accusation. 
+ interrupts interviewer to maintain 
about himself, 
3. forceful emphasis of the position without accom- 
Panying hostility (i.e, a minimal amount of hostil- 


ity). 


1. maintains 
face of Oppo: 


a position 


Operation Puzzle 
5 * 
1. ignores instructions even 
aminer. 


2. repeats same pattern of response even when it 
does not achieve the goal. 


3. asserts “sis belief in Lis abil'*y to solve the puzzle, 


when repeated by ex- 


Cther variables were defined in a similar 
manner. t 
s Method 
The present study consists basically of two 
parts. The first of these is a comparison of 
two groups of individuals in two life situations 
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in which aggression might be expressed. The 
second part of the study #3 concerned with the 
correlation between aggression as expressed in 
each of the life situations and in the Rorschach 
protocol as a whole. i ; 
Sample. From the student records in the 
office of the Dean of Students of a small a | 
college in Ohio 81 male students were selecte 


` for testing. Younger students were given prior- 


ity if their IQ was average or above and there 

was nothing in their records to indicate emo- ~ 
tional maladjustment. It was hoped, by the 
selection of Negro students, to decrease pany 
lems of rapport which might arise because 2 
racial differences between experimenter an 


hibited in their display of aggression. Youngs 
students with less experience as experimentā’ 
subjects could be expected to react more nang 
ally. It was felt that a greater degree of coop 
eration would be insured by eliminating overt- 
ly maladjusted students. The IQ range was 
limited to average or above to decrease the 
Possibility of sparse records, 

Certain cultural traits of American Negroes 
were expected to modify behavior in the a 
perimental situations. An analysis of the su i 
jects’ family background and familiarity wit 
their behavior on campus led to the conclusion 
that respect for authority, expression of feeling 
by indirection, and a fairly rigid code of et- 
quette were characteristic for this group. Stat- 
us might decrease or incréase the amount of 
aggression overtly displayed. The occupational i 


subject. Males were expected to be less in- 


k 


status of parents indicated that the group on %® 


the whole was middle class. 

Selection of subjects for the final phases of 
the experiment was on the basis of the number 
and type of S produced. Each test was given & - 
preliminary examination to score S, alone, at 
the end of each day’s testing. For the experi- 
mental group only subjects who gave two or 
more reversals, i.e., responses in which the 
white space was perceived as the figure and the 
dark or colored portions of the blot as the 
ground, were selected. 


Approximately half of the 38 subjects tested 
produced some 8. Eleven of these met the re- 
quirements. These students were then paired 
on the basis of age and Otis IQ-with those 
who produced no §. Three pairs were dropped 
from the group because of leaving schovl or 


—w. 
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erroneous scoring of S in their protocols. 
The final? sample consisted of 16 subjects 
divided equally between the groups. The mean 
difference in IQ between pairs was three, with 
a range from nine to five. The mean difference 
in age was 11 months with a range of 0 to 26 
months. The experimental group ranged in age 


from 18 to 23 (median 19.5) and in Otis IQ 


from 99 to 117 (median 108.5). The control- 


group ranged in age from 18 to 22 (median 
19.5) and in Otis IQ from 99%to 112 (median 
108.5). The largest proportion of the total 
sample was freshmen. 

Procedure. The Rorschach test was ad- 
ministered in the usual manner with no excep- 
tions. After all experiments had been com- 
Pleted, the tests were scored by the author 
according to the Beck method. The scored 
records and protocols were typed for mailing 
to the judges. 

‘wo months elapsed between the adminis- 
tration of the Rorschach and the two experi- 
Mental situations. Two situations were planned 
Which differed in the type of conflict induced ; 
One of them was designed to simulate as close- 
Y as possible a life situation. Behavior was 
recorded by two observers in the first situation 

Problem solving) and by observers and wire 
recordings in the second (interview). Unsu- 
Pervised observers in the first situation were 
Spa in recording behavior by a detailed 
oe In the interview situation the author 
and e while a hitden observer took notes 
Dra Operated the wire recorder. These two 
ane keeping running notes of reactions 

VO occasions before the subjects were seen. 
es problem-solving situation, deviant 4 
tin reaction to intellectual frustration a 
GF Up a goal difficult to achieve, preceded the 
D crview by three to seven days. The Seashore 
+ arg puzzle [8], selected for this aren 

i Sue of a three-peg board and six gradar 
asil with holes which allow them to be slippes 
to y on the pegs. The goal of the puzzle 1$ 
to me all six disks from the left-hand peg 
One ai extreme right-hand peg; moving only 
di isk at a time and never-placing a larger 
oe a smaller one. Two psychology stu- 
iner a as examiner and etA 
and a r re the instructions and ept the time 
While p 08 record of the subject’s behavior, 
7 the observer counted the number of 


ent, 
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moves and interruptions. A time limit of 30 
minutes was set, but the subject was not in- 
formed of this limit unless he used all of the 
time. He was then informed “Your time is 
up.” When the subject failed to observe in- 
structions, the examiner reminded him by re- 
peating pertinent parts of the initial instruc- 
tions. Questions were answered in the same 
way. If the subject completed the test in less 
than 30 minutes, the examiner waited not less 
than five minutes for the subject to ask to re- 
peat the test. If within this time the subject 
did not volunteer to repeat, the examiner 
asked him if he would like to do it again and 
accepted whatever answer was given. Through- 
out the situation the examiner exerted a mini- 
mum of pressure on the subject. 

It was assumed that in the interview situa- 
tion the interviewer blocked the path to the 
subject’s goal, his vocational choice. Preceding 
the interview a questionnaire concerning the 
subject’s academic history, vocational. choice, 
extracurricular activities, and family constel- 
lation was mailed with a letter to each student 
stating that the author had completed analysis 
of the Rorschach tests and wished to interview — 
him. It was requested that the completed ques- 
tionnaire be returned at the time of the inter- 
view [4]. 

The interview office contained a small 
closet. The observer sat in this closet, operated 
the wire recorder, and kept a running record 
of the subject’s behavior. The subject sat next 
to the interviewer's desk. As the subject was 
admitted, the observer started the wire re- 
corder so that the sound could become part of 
the room noises. The interview was usually 
opened by the interviewer asking for the ques- 
tionnaire, sometimes by the subject offering it. 
The interviewer would then read through the 
questionnaire rapidly and ask the subject, 
“What difficulty are you having with your 
classes?” Next the interviewer requested “Tell 
me more about why you would ‘like to be a 
aa , ” naming the subject’s vocational choice 
as stated in the questionnaire. Following the 
subject’s response, the interviewer preténded 
to read the subject’s Rorschach report and then 
stated seriously: “After considering your re- 
cords carefully, your Rorschach, the report of 
your puzzle performance, and what you have 
said here, it’s difticult to see how you’re making 
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the grade. It looks like a pure waste of time 
to me.” A concealed stop watch was started as 
this statement was completed, and the time of 
the subject’s first response, verbal or other- 
wise, was recorded. When the interviewer felt 
certain that the response to this statement was 
completed, the time of the last response was 
recorded. The interview was terminated with 
an explanation of its purpose; questions were 
answered and a thorough attempt was made 
to desensitize the subject before he left. 


The three situations provided settings for 
different roles for the participants, observers, 
and subjects. Use of the Dean of Student’s of- 

ce and its services gave the author quasi-of- 
ficial status, which was further enhanced by a 
notice placed on the bulletin board that the 
author, an employee of the U. S. Public 
Health Service, was engaged in making a sur- 
vey of normal young men. The role of an ob- 
jective psychologist was developed by not using 
the subjects’ names, with the explanation that 
this enabled the author to remain more ob- 
jective. Living on campus facilitated friendly 
relationships. It was assumed that establishing 
~cuch rapport would reinforce the frustrating 
effect of the belittling statement introduced in 
the interview, Although the assistants in the 
Puzzle situation were Cast as disinterested ob- 
Servers, there was evidence that a few of the 


subjects felt some Personal involvement with 
the observers, This is 


Student body is small. Nevertheless it is felt 
that the subj i i 


Each category of aggression and the assumed 
Opposites were set up as an independent five- 
Point rating scale; all seven scales were printed 
on a single page. Rorschach, puzzle, and inter- 
view protocols were rated by means of the same 
scales. Judges of the Rorgchach records were 
asked to arrive at an interpretation of the 
whole record and to record their impression of 
each subject on the rating scales. There was 
no training period; instructions and records 
were mailed. Judges `of. the Rorschach w-se 
selected primarily on the basis of their training 
ia the Beck system,® Judges of the other two 
situations were selected because of their famili- 


8Drs. Seymour Klebanoff, Herman Molish, Alan 


Rosenwald, and Meyer Williams acted as Rorschach 
judges. i; 


vo? equaled .C1. For initi 
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arity with ratiag procedures,* a separate group 
rating each situation. The author-acted i 
judge for all situations. Definitions and in 
structions were reviewed for each judge be- 
fore the ratings were performed. The pro 
cols were identified only by case number, an 
these were masked before the author acted as 
a judge. 
Results 


Results of the statistical analysis of data will 
be presented in the following order: (a) re" 
liability of ratings of aggressive behavior in the 
life situations ; (b) significance of differences 
between groups high and low in S; (c) ratings 
of aggression expressed in the Rorschach per- 
formance; (d) correlations between ratings o 
aggression in the life situations and ratings 9 
aggression on the Rorschach records. i 

Reliability of ratings of aggressive behavior 
in the life situations. Reliability coeficients 
were calculated using the total group of 18 
subjects." Each coefficient represents intercorre- 
lation between three judges for the puzzle 
situation and a different group of three judges 

ti s 


Table 1 
Reliability of Ratings 
(N = 16) 
Situation h 
Behavior category Puzzle Interview Rorschac! 
Assertion 15 -58* 74" 
Initiative 554, u 6409 105 
Persistence .59%% -51* Ar 
Resistance ms 41 65" 
Hostility 738% 71 57° 
Cooperation 49" 27 1729" @ 
Rapport -56™ 47" A4 
* Significant at .05 level, 


** Significant at (01 level, 


for the interview situation. For persistence and 
hostility in the puzzle situation and for ini- 
tiative and hostility in the interview situation 


ative, cooperation, and 
rapport in the puzzle situation and for asser- 
tion, persistence, and rapport in the interview 
situation $ was .05. These findings indicate 


that of the Sever; behavior variables under con- 


‘Miss Alene Gustavson and Dr. ‘Harry Klehr 


rated interview records. Dr. Ross Morgan and Mr- 
Dave Murray rated puzzle records. $ 


5Calcùlated by a method suggested by Dr. E. L- 
Clark. ` 


-== 


=. 
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sideration, four (initiative, persistence, hostil- 
ity, and rapport) were measured reliably by 
both the puzzle and interview situations; coop- 
eration was measured reliably only in the puz- 
zle situation and assertion only in the interview 
Situation. 

Significance of differences between groups 
high and low on S. In order to test the signi- 
ficance of differences between groups, ratings 
for ‘each subject were averaged and the usual 
t test was made. A significant level of differ- 
entiation (p = .05) between groups was ob- 
tained in the interview situation on the fol- 
lowing variables: initiative, resistance, hostil- 
ity, cvoperation, and rapport. Differentiation 
at the same level was obtained in the puzzle 
Sfuation on assertion and hostility. 
nating discussion to differences at the .05 
a of confidence or better: (a) in the inter- 
the Situation the group high in S response on 

“a exhibits more initiative, more 
port fe but also more cooperation and rap- 
uation. tn resistance; (b) in the puzzle sit- 
ess. as the group high in S response exhibits 

assertion and less hostility. 
the —_ as the interview situation is concerned, 
indie hypothesis is confirmed, namely that 
Rressive: ne high on § response are more ag- 
More i “hey are aggressive in being generally 
in ¢ ronan and interactive. However, 
o He ie situation (primarily a situation 
action ectual challenge involving social inter- 
uals any peripherally) the high S individ- 
gestion tee aggressive. There is a strong sug- 
in the q at the two situations differ markedly 
Dine a e to which they elicit aggressive 
ati as measured in this study. 
chach pad of aggression expressed in the Ror- 
Judges ess ormance. Intercorrelations between 
own sags the total Rorschach record are 
Was dint Table 1. A probability level of .01 
Varia i aed for the intercorrelations on the 
sistance. oe initiative, persistence, a 
ions for i cooperation. The intercorrela 
level, 1 ostility were significant at the 05 
Were in ee Coefficients suggest that the raters 
ME the onsiderably greater agreement in rat- 
either p orschach than they were in rating 
: Sows bagi or the puzzle situations. 
™ the ife ton between ratings of aggression 
On the p Stations and ratings of aggression 
°rschach recard. Coefficients of corre- 


é 
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lation between the ratings of aggression on the 
total Rorschach and those for each of the life 
situations are shown in Table 2. The correla- 


Table 2 


Correlation between Ratings of the 
Life Situations and the Rorschach 


Situation 
Category Puzzle Interview 
Assertion 34 —37 
Initiative —.11 .21 
Persistence 52° 35 
Resistance —.17 —.40 
Hostility —.08 .27 
Cooperation 19 —.01 
Rapport —.30 —.11 


* Significant at .05 level. 


tion for the variable, persistence, in the puzzle 
situation is significant at the .05 level of prob- 
ability. The probability approached the 05 
level for the variable, resistance, in the inter- 
view situation. A general conclusion is that 
there is little relationship between the aggres- 
sion inferred in either situation and that in- 
ferred from the total Rorschach. The largest 
coefficient (.52) suggests a slight correspond- 
ence between the puzzle and Rorschach situa- 
tions for persistence, in the direction which is 
perh@ps expected. In the interview situation, 
however, the largest coefficient (—.40) sug- 
gests that those who seem most resistant on 
the Rorschach seem least resistant in the inter- 
view situation. 


Summary and Conclusions 


In order to demonstrate that the interpreta- 
tion of the Rorschach white space score, S, as 
aggression is valid, 16 Negro males between 
the ages of 18 and 24 were subjected to intel- 
lectual and interpersonal frustration after hav- 
ing been given the Rorschach test. The result- 
ant observations of behavior in two situations, 
a problem-solving test and an interview, and 
the scored Rorschach tests were subjected to a 
rac'ng procedure on a sive-point scale of aggres- 
sion, composed of five behavior variables, and 
a noragegressive scale, composed of two behav- 
ior variables. 

Of the five aggressive variables the most re- 
liably rated were initiative, persistence, and 
hostility. Of the two nonaggressive variables 
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rapport was the more reliably rated. 

The major conclusions from the study are: 

1. The high S group was more aggressive 
(in a participatory, interactive way) in a frus- 
trating interview situation than the low S 
group. 

2. The high S group was no more aggres- 
sive than the low S group in a situation of in- 
tellectual challenge in which social interaction 
was at a minimum. 

3. The judges’ impressions of aggression as 
inferred from the total Rorschach record were 
but slightly related to aggression as measured 
in the interview and puzzle situations. 


Received May 18, 1953. 
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The Effects ôf Figure-Ground Contrast Upon Per- 
ception as Evaluated by a Modified 
Rorschach Technique’ 


Arvord W. Belden and E. Earl Baughman 


University of Wisconsin 


s dn ‘a recent article [1] results of re- 
mareh designed to clarify the role of stimulus 
es peeing percentual p 
second R hach test were presented by 
se author. Among other things, this re- 
arch demonstrated a significant increase in 
st movement responses (scored as M 
on A a S according to Rorschach convention) 
Sound houette series of blots in which figure- 
act, rel contrast had been maximized. The ex- 
trast pe between figure-ground con- 
tionshin movement responses, as well as rela- 
exhibited with other dimensions of perception 
Specified on the Rorschach test, could not be 
at the. however. This was due to the fact 
trast ae was no systematic variation of con- 
utilizati the experiment, but rather only a 
either ae of stimuli in which contrast was 
ese ie ðr maximized. Examples of 
White? ar extremes can be seen in Fig. 1, 
} they are indicated as Cards A and G. 

a 2 Purpose of the present paper is twofold: 
oe eset data which make possible a sys- 
re analysis of the relationship between 
Micha contrast and perception 1n = 
eximi type situation, and (4) to present 

rojecti Pie of how methodology employed with 
full ai € techniques may be combined fruit- 

9 otal more traditional experimental meth- 

Cr onal the goal of a more complete un- 

ng of perception. 


tem, 


FT 

A, The autho: 
. Gr: 

critici BS 

also 
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rs wish to thank Drs D. W. Fiske, D. 

Calden, and H. A. Page for their 
expre rining to this article. Appreciation is 
Rep Sis pea to Drs. P; A. Mote and H. Leibowitz 
periment © in constructing materials used in the 
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Method 

Stimulus materials. A graded series of seven 
stimulus figures was used in the experiment, 
the figures differing from one another only in 
terms of the amount of light reflected. The 
form of each figure was identical to that of 
Card II in the Rorschach test. Card II was 
selected as the basic form for this study because 
of its demonstrated ability to evoke movement 


Fig. 1, Stimulus figures A and G (left to right). 


Table 1 


Percentage of Difference in Light Reflected 
between Figure and Ground 


Card Figure-ground Difference between 
difference cards 
A 0 
13.1 
B 13.1 
18.6 
Q 31.7 
a 2710 
D 53.7 
225 S 
E 76.2 3 
15.0 
F 91.2 
5.7 
G 96.9 
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responses [1]. The two extremes of the seven 
stimulus cards are presented in reduced size in 
Fig. 1. Table 1 indicates the percentage of dif- 
ference in light value between figure and 
ground for each card as measured by a Mac- 
beth illuminometer. 

Cards B through G were prepared by cover- 
ing the figure on Card II in the standard Ror- 
schach with a solid coat of black India ink (in 
order to eliminate color, shading, and internal 
form effects) and then photographing the card. 
Actual size prints were then made with dif- 
ferent contrast values. As can be seen in Table 
1, the difference in contrast between Cards F 
and G was less than that between Cards B-C, 
C-D, D-E, and E-F, the latter cards differing 
from one another in approximately equal step 
intervals, Card G was included, however, in 
order to provide a card with maximum figure- 
ground contrast within the limitations of the 
photographic process used. Card G will be re- 
ferred to hereafter as the figure with maximum 
contrast, and Card B will be referred to as the 
figure with minimum contrast. Cards F 

_ through B were identical to Card G in Fig. 1 
“except for systematic decrements in figure- 
ground contrast. 

Card A is termed a peripheral line figure 
and was included in the series in or 
vide a stimulus 
the white of t 
of the groun 
transparent p: 
card and tra 
was always 


der to pro- 
without figure-ground con&ast, 
he figure being the same as that 
d. It was created by placing a 
aper over the original Rorschach 
cing in such a way that the pen 
in contact with both the white 
ground and either a shaded or colored portion 


of the card. Photographing then followed the 
procedure outlined above. 


Experimental de 
of 140 subjects wa: 
subjects being ran 


sign and subjects. A total 
S used in the experiment, 20 


domly assigned to each of the 
seven cards. All subjects were white male stu- 


dents enrolled in an introductory psychology 
course at the University of Wisconsin. After 
the composition of the groups had been deter- 
mined, the groups were compared in terms “Sf 
age, «intelligence, and educational level since 
these variables are known to affect Rorsthach 
performance. Analysis of variance revealed no 
significant differences between the groups with 
respect to these variables. 

Testing procedure and treatment of data. 


Arvord If’. Belden and E. Earl Baughman 


All subjects were tested by the first author in 
order to eliminate examiner differences [2]. 
The entire testing situation was recorded by 
wire recorder to insure complete and accurate 
protocols. Uniform instructions, adapted from 
Beck [3], were given to each subject as fol- 
lows: 


You will be given a card with a design on 1t. 
Look at the card and tell me what you see or any- 
thing that might be represented there. Look at the 
card as long as you like, only be sure to tell me 
everything that you see on the card as you look at 
it. When you are finished with the card lay it down 
on the desk as a sign that you are through with it. 


No encouragement for greater productivity 
was given after the first response. Upon com- 
pletion of the free association a standard im- 
quiry was conducted. Each protocol was then 
summarized by the first author following 
Beck [3], except for the addition of Klopfer’s 
FM score [7]. Seventy-six responses were also 
scored independently by the second author, 
perfect scoring agreement being found on 88 
per cent of the responses. The scoring cate- 
gories utilized are listed in Table 2. 


The data were analyzed in terms of group 
comparisons, each group being compared with 
every other group in respect to each of the 
scoring categories. Fisher and Yates’s [5] ex- 
act method was used to test the significance 
of differences in frequency between groups- 
The theoretical frequencies, used in this pro- 
cedure were determined by casting the scores 
of all 140 students into total distributions for 


each of the scoring categories and choosing a 


cutting point as close to the median value 29 
possible. It was necessary to use this statistical 
technique because of two factors: (a) the 
marked skewness of the distributions of most 
Rorschach scoring categories and (4) the 
small theoretical frequencies in some cate- 
gories. Such difficulties in the statistical hand- 


cling of Rorschach data have been reviewed by 


Cronbach [4]. 


Two exceptions in the above handling of the 
data are to. be noted, however, involving: (4) 
average time per response and (b) average total 
time per subject. The characteristics‘ of these dis- 
tributions Were such as to permit an analysis 9 
variance technique. This analysis was carried out, 


in addition to the exact method, for the above tw? 
scoring categories, 
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Results 


A table ‘presenting median and mean scores 
for each group in each scoring category may 
be secured from the American Documentation 
Institute.’ Table 2 indicates significant dif- 
ferences between groups for each scoring cate- 
gory when each group was compared with 
every other group by the exact method. Fig- 
ures 2, 3, 4, and 5 present graphs of the rela- 
tionship between degrees of contrast and 11 of 
the 16 measures of perceptual behavior used in 
this study. Five measures (D, Dd, P, FM, 
and M + FM) are not graphed since they re- 
vealed linear relationships with approximately 
Zero slope comparable to 7 and M as seen in 

18. 2. Card A is left discontinuous with the 
"smaining cards in Fig. 2, 3, 4, and 5 for two 
reasons: (a) to emphasize the marked differ- 
ence between this card and the remaining 
cards as perceived by the subjects, and (%) to 
re € more clear the orderly relationship be- 

Wee n degree of contrast and perceptual be- 
rand as long as at least a minimum brightness 
rast is maintained. Figures 4 and 5 were 


Si Table 2 
Bnificant Differences between Groups According 
to Scoring Categories 


Scor} 
Seng category* Significance level 


01 05 
R A-B 
D T A-B, A-G 
m B-A, D-A, C-A 
F-A p 
E- 
Total (—) Form A-B, A-C 
B-A, C-A, 
D-A, F-A E-A, G-A 
S A-B A-D, A-F 
T/IR F-C, F-G 
T/R B-E B-A, B-D 
T. Time B-C 


J e . 
of they The first letter in each entry indicates which 
ing XO, grouns exceeded the other withsrespect to the 
tivity ‘oo For example, A exceeded B in pro- 

A : 
+L)" pCOmparisons for W, Dd, M+FM, FY, Total 
level „frm, and Content Categories.reached the -05 


Not listeg nificance; hence these scoring categories are 
“din the table. 


2 
> bit Document No. 4076 from ADI Auxiliary 
pons Project, Photoduplication Service, Li- 
mai vang u8tess, Wasnington 25, D. 2., remitting 
8. Mo $1.25 for microfilm or $1.25 for photo- 
D Se fe checks payable to Chief, Photodupli- 
‘vice, Library of Congress. 
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Fig. 3. Median scores for R, Content Categories, 
Total (+) Form, and Total (—) Form. 


constructed on the basis of mean scores for the 
time categories since the characteristics of 
these distributions were such as to suggest that 
the means would be more reliable measures 
than the medians. 

` Nineteen of the 22 entries in Table 2 in- 
volve Card A, thus emphasizing the marked 
changes occurring in perceptual behavior when 
brightness contrast between figure and ground 
is eliminated. This is best seen by the fact that 
the most frequent response given, to this card, 
two humans in some type of activity, dimin- 
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Fig. 4. Mean score for T/1R. 


ishes markedly in frequency on Card A (see P 
and M scores in Table 2). In addition, the 
subject is much more likely to restructure 
figure-ground relationships on Card A (see S 
score in Table 2) than on the remaining cards. 

hese findings are consistent with previous re- 
sults obtained when figures comparable to 
Cards A and G were utilized [1]. 


Our primary interest from the beginning 
was with the relationships which would unfold 
on Cards B through G. On these cards the 
figure is defined for the subject by means of a 
brightness contrast, the only difference between 
the cards being in terms of degree of brightness 
contrast. Table 2 and Fig. 2 and 3 point to no 
significant a ene relationships between 
contrast and the following scoring categories: 
W, D, Dd, M, FM, M + FM, P. S and 
Total (—) Form. Only W, M, and Total 
(Gy) Form are graphed to illustrate these re- 
lationships, thus showing that they may be de- 
scribed essentially Ly a Stiaight line with zero 
slope. Figure 3 indicates, however, an increase 


rschach conven- 
(+) Form, Total (—) 
+3. To obtain Teal 
rm scores, all re- 
racy or inaccuracy 
hong ondareei 
en utilized, 1s was i- 
tated by the small sample of behavior secite Fen 
u Content Categories refers to the 


number of different types of content percei 
. Cely 
the subject. - p zad by, 
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in three scores (R, Content Categories, and 
Total [+] Form) as contrast increases, until 
a maximum is reached on Card E, following 
which there is a decrease in these scores with 
further increase in contrast. Figures 2, 4, and 
5 indicate a reverse type relationship between 
contrast and four other scores: Total Time, 
T/1R, T/R, and FY. These scores reach a 
minimal point on Card E (except for TAIR 
which reaches a minimum on Card D) and 
then increase with further increase in contrast. 

When T/R scores were subjected to an a- 
nalysis of variance, the resulting F was found 
to be very significant (F = 5.20, where F = 
2.95 is significant at the .01 level). An F = 
2.06 was obtained when Total Time scores 
were subjected to a similar analysis, where an 


F = 2.17 would have been significant at the 
-05 level. 


Discussion 


Since previous research [1] had demon- 
strated a marked increase (in comparison with 
standard Rorschach forms) in movement re- 
sponses (M) on a series of blots with contrast 
values comparable to those of Card G in the 
Present study, it was anticipated that an in- 
crease in M responses would be demonstrated 
corresponding to an increase in contrast values. 
This relationship was not found, however, A 
Possible explanation for this resides in the uni- 
formally Consistent level at whic 
responses, were evoked by the particular form 
which was chosen for this study. Thus, the 
range-of behavior with respect to Gnovemiene 
responses proved to be too constricted for an 


h movement 
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adequate test of this hypothesis. The need for 
further work with diverse forms providing 
wider variations in perceptual behavior is clear- 
ly indicated. ; 
The systematic relationships pictured in Fig. 
2, 3, 4, and 5 between contrast and seven of 
the scores used to evaluate perceptual behavior 
form the basis of an interesting hypothesis. 
These curves reveal that more responses (R) 
are given in shorter time ( T/R, T/1R, Total 
Time) with greater accuraty (Total izal] 
Form) and with greater variety in content 
(Content Categories) when figure-ground con- 
trast is intermediate in value rather than mini- 
mal “or maximal as defined in this study. 
Moreover, if one accepts the validity of the 
usual Rorschach interpretation of FY re- 
Sponses, the data suggest that feelings of un- 
easiness or anxiety may diminish at intermedi- 
ate contrast values. The data are so limited in 
the FY category, however, that only a very 
tentative suggestion in this direction is justi- 
fied. 7 
Consideration of the above relationships im- 
Mediately suggests the idea that perceptual be- 
avior is most efficient when figure-ground 
Contrast is at a level comparable to that pro- 
vided by Card E (a level at which the figure 
reflects approximately 25 per cent as much 
light as is reflected by the ground). As one 
either increases contrast beyond this point, or 
decreases it, perceptual behavior tends to be- 
come less efficient. This interpretation of the 
data is consistent with a definition of efficient 
behavior which stresses maximal output per 


“Unit time at a high level of accuracy concomit- 


ant with pleasant feeling tone. f 
The methodology used in this study differs 
Tom that of the more usual experimental ap- 
Proach in which both the stimulus conditions 
and the subject’s responses are rather rigidly 
Controlled, In this experiment we have chosen 
instead to control carefully the stimulus con- 
'tions but to make multidimensional measure- 
ments of free or unstructured responses by the 
Subjects. This is equivalent to saying to the 
Subject, “If this stimulus condition affects you 
then you are free to show us how it affects 
You,” rather than, “If this stimulus affects you 
ehh it must affect you through the behavior 

ich we have already selected.” 

n obvious criticism arises immediately, 


however, in the sense that the many measures 
used to evaluate the behavior are not measures 
of independent functions. This problem has 
been discussed elsewhere by Fiske and Baugh- 
man [6]. By ferreting out these interrelations 
before variations are introduced into the stimu- 
lus conditions we should be able to overcome 
these difficulties. Thus, a previous study [6] 
has shown that as productivity (R) increases 
there is a correspondingly regular increase in 
F+ and F— responses. Consequently, the fact 
that we get such an increase in F+ responses 
in the present study but zo? a similar increase 
in F— responses makes more meaningful the 
interpretation which we have given to the data. 

It is possible, of course, that our results are 
due to the particular form which we chose to 
work with or to unidentified differences be- 
tween our groups. Further research will be nec- 
essary to determine whether the concept of per- 
ceptual efficiency, in the sense that we have 
proposed it, will hold with other groups of sub- 
jects and stimulus forms. 


Summary 


Seven figures were constructed comparable” 
to Card II in the Rorschach test with respect 
to form, but differing from one another in de- 
gree of figure-ground contrast. Each of these 
sev cards was administered to a different 
group of 20 male subjects who were randomly 
assigned from a total of 140 subjects in ele- 
mentary psychology courses. Administration. 
and scoring of protocols followed accepted Ror- 
schach procedure. Each group was then com- 
pared with every other group in order to de- 
termine the relationship between contrast and 
perceptual behavior, with the following find- 
ings: 

1. Nineteen out of 25 significant differences 
in Rorschach responses between cards involved 
Card A on which there was no brightness con- 
trast between figure and ground. 

2. When Cards B through G were con- 
sidered (on which approximately equal step 
ia creases in contrast vere present) no relation- 
ship between contrast and the following fac- 
tors*was found: W, D, Dd, M, FM, M ~- 
FM, Total (—) Form, P, and S. 

3. When Cards B through G were con- 
sidered, R, Content Categories, and Total (+) 
Form were found to increase with increasing 
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contrast until a maximum was reached on Card 
E; these scores then decreased with further in- 
crease in contrast. 

4. When Cards B through G were con- 
sidered, T/1R, T/R, Total Time, and FY 
were found to decrease with increasing con- 
trast until a minimum was reached (usually 
on Card E) ; these scores then increased with 
further increases in contrast. 

These findings were interpreted in terms of 
the concept of perceptual efficiency. It was 
suggested that perception is most efficient at a 
point of contrast which falls between the mini- 
mum and maximum as defined in this study, a 
point at which the figure reflects approximately 


25% of the light which is reflected by the 
ground. 
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Interrelationships Among Several Measures 


> 


of Anxiety and Hostility ` 


Leonard D. Goodstein 
State University of Iowa 


The problem of anxiety and its measure- 
ment has become increasingly important in 
contemporary psychology in both clinical and 
experimental work. 

The Taylor Manifest Anxiety Scale. The 
Taylor Manifest Anxiety Scale (4 scale) [8, 
9, 24, 25] has been widely employed as a 
measure of anxiety. The 4 scale, initially, con- 
sisted of 65 MMPI items that were rated by 
judges to be indicative of anxiety; those items 
found to be nondiscriminating, through item 
analysis, were subsequently eliminated. The 
Present scale consists of 50 such items. 

Validity studies of the Æ scale have been 
of three types. A number of experimental 
Studies have assumed that d-scale scores are 
an index of the Ss’ state of reactivity or excit- 
ability, which in turn reflects their general 
level of drive (D). Using Hull’s [12] theo- 
retical formulation relating response strength 
to drive, these studies have predicted perform- 
ance in a variety of laboratory experiments, 
involving conditioning [1, 10, 16, 21, 22, 24], 
reaction time [18, 27], verbal learning [15, 
17, 23, 26], as well as several more complex 
behavioral situations [5, 19, 20, 28, 29]. 

Secondly, several attempts have been made 
to relate 4-scale scores to manifestations of 
Clinically diagnosed anxiety states. Gleser and 

lett [6] reported a correlation of .61 be- 
tween 4-scale scores and psychiatrists’ ratings 
Of anxiety proneness. Lauterbach °[14] found 
à Correlation of .31 (significant beyond the 1% 
evel of confidence) between 4-scale scores and 
Psychologists’ ratings of overt anxiety, but the 
Correlation with psychiatrists’ ratings was not 
‘nificantly, different from zero, 


: : j 

in Based on a paper presented at the annual meet- 

Chi of the Midwestern Psychological Association, 
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Thirdly, additional information on the 
clinical validity of the 4 scale is found in those 
studies reporting the relationships between 4- 
scale scores and other tests purporting to 
measure anxiety and other personality vari- 
ables. Lauterbach [14] reported a correlation 
of .62 between the 4 scale and Welsh’s Anx- 
iety Index, an empirically derived MMPI anx- 
iety measure, while Holtzman eż al. [11] 
have reported a correlation of .86 with the 
Winne Scale of Neuroticism, another empir- 
ically derived MMPI measure. 

The present study is of the third type. It 
represents an attempt to study the relationshi 
between 4-scale scores and two other measur- 
ing instruments, the Elizur Rorschach Con- 
tent Test and a new, multiple-choice form of 
the TAT. 

he Elizur Rorschach Content Test. A 
relatively new technique for scoring Rorschach 
protocols,- based on an analysis of protocol 
content, has been developed by Elizur [3]. 
Rorschach responses containing clear-cut evi- 
dence of strong anxiety, such as a frightening 
giant, are given score credit of 2, while re- 
sponses containing less clear-cut evidence, such 
as an unpleasant animal, are given score 
credit of 1. A quantitative score expressing 
the amount of anxiety is then obtained by 
totaling the score credits*for a particular pro- 
tocol. A hostility score is obtained in a similar 
fashion. 

Elizur [3] found significantly high correla- 
tions between his Rorschach anxiety scores and 
inuicators of anxiety derived from interviews, 
questionnaires, and rating scales obtained trom 
normal subjects. His anxiety score was also 
found to differentiate (at the 1% level of con- 
fidence) between a group of psychiatrically di- 
agnosed neurotics and a group. of normals 
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who had been matched on the basis of other 
relevant variables. 

The Iowa Multiple-Choice Picture Inter- 
pretation Test. Because of the limitations in- 
volved in the usual administration and scoring 
of the TAT, a simpler method of presentation 
and a more objective method of scoring was 


devised as part of a research being carried on 
at Iowa. 


Ten TAT cards, 1, 2, 4, 68M, 7BM, 7GF, 
8BM, 13, 14, and 17BM, were selected on the 
basis of Eron’s [4] normative data and per- 
sonal experience. Four alternative responses 
were prepared for each of these pictures; each 
response was composed of a single statement 
involving one of the following types of themes: 
anxiety, hostility, achievement, and blandness. 

Card 8GF, a young woman sitting with her chin 
in her hand looking off into space, was used for the 
Purpose of illustration. The four alternatives to this 
sample picture were: 

A. She feels that she cannot go to the party be- 
cause no one ever asks her to dance. (Anxiety) 

B. She is annoyed because she has to work while 
her friends go out. (Hostility) 

C. She is looking forward to her opening night 

“cs the star of a great show. (Achievement) 

D. She is listening to her favorite radio pro- 
gram. (Blandzess) 

The Ss are asked to rank order these alternatives 
according to the interpretation they would be most 
likely to give. Each area or theme is scored á~ the 
sum of the assigned ranks. It should be noted, there- 
fore, that the lower the numerical score, the higher 


the over-all preference expressed for the particular 
alternative. 
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While little is known at the present time 
about the usefulness of those scores, Daily and 
Hurley [2], in a preliminary study, demon- 
strated that subjects scoring high on the 
achievement variable” gave significantly more 
anticipations in a verbal learning situation 
than those scoring low in achievement. Hurley 
[13] has essentially confirmed these results. 


Hypotheses 
The specific hypotheses were: 


1. The three measures of anxiety will be 
positively related. 

2. The two measures of hostility will be 
positively related. 

3. The anxiety measures will be negatively 
related to the hostility measures, as individuais 


able to express hostility should be less anxious 
than those unable to do so. 


Subjects and Procedures 


The three tests, the 4 scale, the group Ror- 
schach (administered according to Harrower’s 
[7] instructions and scored according to Eliz- 
ur’s [3] system), ana the Iowa Multiple- 
Choice Picture Interpretation Test, were ad- 
ministered to 57 college students enrolled in 
an undergraduate course at the State Universi- 
ty of Iowa. 


Results 


A complete intercorrelation matrix of test 
scores (including the total number of Ror- 


Table 1 
Intercorrelation Matrix among All Test Scores 
(N = 57) ii 
Rorschach Picture Interpretation Test 
total Elizur 
Test R Anx. Host. Anx. Host. Ach. Bland 
Taylor A scale te a r a a Ue 
Rorschach total R .25* —.25* 14 03  —12 —.02 
Elizur anxiety .07 —06 —06  —02 Ae 
Elizur hostility —.08 —02 02 “02 
Picture .nterpretation ~>st* 
Anxiety 11 —60 = 
Hostility —.72 a 
Achievement È 46 
Blandness . 


* Significant at .05 level of confidence. 
é Significant at .01 level of confidence, 


+ The interc-rrelations among the Picture Interpretation Test scores arı 


procedures. 


a 


e confonnded by the rank-order scoring 


| 


schach responses in each protocol) was con- 
structed ard is presented in Table 1. 

As may be observed in Table 1, a low but 
significant positive correlation was found be- 
tween 4-scale scores and Elizur anxiety scores, 
indicating some common variance. A low but 
significant positive correlation was found be- 
tween total number of Rorschach responses 
and Elizur anxiety scores while a negative 
correlation of the same order was found be- 

. tween total R and Elizur hostility scores. 


© This would seem to indicate that Ss who 


give many responses tend to give responses 
‘Scored in the anxiety category while those giv- 
ing féWw responses tend to give responses scored 
in the hostility category. 

,No significant relationships were demon- 
strated among the 4-scale scores and the Ror- 
schach scores on the one hand and the Picture 
Interpretation Test scores on the other hand. 

€ anxiety and hostility scores provided by 
the Picture Interpretation Test do not seem 
to tap the same sources of variance as the 
other measures, 


_It is difficult to interpret the intercorrela- 
tions among the Picture Interpretation Test 
Scores, as these relationships, at least in part, 
are due to an artifact of the rank-order scor- 
Ing procedure. 


As the 4 scale has usually been found to be 


Nondiscriminating over the middle range of 
Scores, two groups.of Ss (anxious and nonanx- 


lous) were selected from the extremes of the 
‘scale distribution. Each group consisted of 


Ss whose 4-scale scores fell, respectively, 


y PA Within the upper and lower 20% of scores for 
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a standardization population of about 2,500 
Ss. The performance of these two groups was 
then compared on each of the other measures. 

The means and standard deviations for the 
anxious and the nonanxious groups, the re- 
sulting ż’s, and,the probability estimates for 
the #’s are presented in Table 2. In the first 
four cases single-tailed hypotheses were used 
since the differences were in the predicted di- 
rection. The anxious group tended to give 
more total Rorschach responses, higher Elizur 
anxiety scores, lower Elizur hostility scores, 
and give greater preference to the anxiety foil 
of the Iowa Picture Interpretation Test than 
the nonanxious group. 

These results are in substantial agreement 
with those reported in Table 2; however, the 
results based on the extreme groups are sta- 
tistically more reliable. The relationship be- 
tween 4-scale scores and total R is essentially 
a confirmation of the findings of Westrope 
[29], who reported that anxious Ss tended to 
give more Rorschach responses than nonanx- 
ious Ss in individual Rorschach administra- 
tions. oe 


Discussion 


The present study is part of a continuing 
series of investigations on manifest anxiety and 
its behavioral correlates. To date, the Taylor 
A scale has been the principal instrument 
utilized in these studies. Recently, however, 
we have become interested in attempting to 
tap this source of variance by some other tech- 
nique. The rather restricted range of 4-scale 
scores in a college population, the lack of dis- 


Table 2 


Means on Seven Measures for Anxious and Nonanxious Ss 
(N = 10 in each group) 


Mean SD 
Test Anx. N-Anx. Anx. N-Anx. t ? 
Pa ee E E S o ee 

Rorschach 

Total R 27.4 21.6 1.7 5.0 1.9 <.03" 

Elizur anxiety 5.2 2.2 2.3 1.3 3.4 <.001* 

Elizur hostility 1.2 3.1 1.3 2.9 1.8 <.04*, 
Picture Interpretation Test w 

nxiety | 23.8 26.4 3.5 4.3 1.4 <.10* 

Hostility 7 27.9 31.7 3.8 5.1 1.8 10 

Achievement 22.2 19.3 41 3.4 0.9 40 

Blandness 26.1 23.4 4.3 4.6 13 20 


* Using si 3 
€ Single-tailed hypothesis. 
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crimination over the middle range of A-scale 
scores, and the susceptibility of the 4 scale to 
faking [9] have, in part, motivated this inter- 
est. It was hoped that the Rorschach or a 
modified form of the TAT would be helpful 
in this regard. The present study would seem 
to indicate that the Rorschach might be some- 
what more helpful than this modification of 
the TAT, 

One might question whether the relation- 
ships among 4-scale scores and Elizur scores 
are merely dependent upon the total number 
of Rorschach responses. Partial correlations, 
holding total R constant, were computed to 
answer this question. The partial correlation 
between d-scale scores and Elizur anxiety 
scores, holding total R constant, was .36, 
while the correlation with the Elizur hostility 
scores, holding total R constant, was —.26. 
These partial correlations are not significant- 
ly different from the whole correlations pre- 
sented in Table 1. The relationship between 
4-scale scores and the Elizur scores does not 
seem to be merely dependent upon the total 

-number of Rorschach responses, that is, some 
general productivity factor. 


Summary and Conclusions 


1. Not all tests thought to measure anyiety 
measure the same variable. Significant rela- 
tionships were found between the Taylor 
Manifest Anxiety Scale and the Elizur Ror- 
schach Content Test of Anxiety. An anxiety 
score derived from the Iowa Multiple-Choice 
Picture Interpretation Test, a modified form of 
the TAT, was not significantly related to the 
two other measures of anxiety. 

2. Not all tests thought to measure hostility 
measure the same variable. No significant re- 
lationship was found between the Elizur Ror- 
schach Content Test of Hostility and the hos- 
tility score derived from the Iowa Multiple- 
Choice Picture Interpretation Test. 

3. The relationship between anxiety and 
hostility depends upon „ue measures used. A 
negative relationship was found between the 
Taylor Manifest Anxiety Scale and the Llizur 
Rorschach Content Test of Hostility while a 
positive relationship was found between the 4 
scale and the hostility scores derived from the 
Iowa Multiple-Choice Picture Interpretation 
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Test. The test of statistical significance, how- 
ever, do not permit muck confidence in these 
results. 
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Certain patterns of response in Lowenfeld’s 
Mosaic Test have been described as character- 
istic of organically impaired subjects. Wertham 
-[7], with regard to adults, and Colm [1] on 
the basis of work with children, report what 
they claim to be typical signs of organicity as 
revealed by Mosaic productions. Colm lists 
four criteria as follows: (a) the additive place- 
ment of pieces side by side, (b) the lining up 
of pieces of the same shape or color, (c) the 
piling of pieces vertically, and (d) the repeti- 
tion of simple geometric designs. 

Wertham describes two general categories of 
organic impairment to which he applies the 
terms “cortical” and “subcortical.” The Mo- 
saic pattern which is typically produced by the 
patient with cortically located brain damage is 
~-arked, he writes, “by an inability to achieve 
good configuration, with a dissolution and dis- 
memberment of the Gestalt.” The subcortical 
pattern is characterized by “stone-bound” de- 
signs, where at the “expense of an inner plan 
the patient follows the impetus inherent in the 
shape and color of the pieces put down so that 
the whole response becomes reduced to a me- 
chanical or automatic level.” In addition he 
provides one diagrammatic illustration [7, p. 
248]. 

Elsewhere the Mosaic Test has been de- 
scribed as refractory to statistical analysis. A 
survey of the literature such as that recently 
completed by Dorken [2] indicates that the 
statistical testing of diagnostic hypotheses in 
this test has not yet been undertaken. Norma- 
tive data have been provided by McCulloch and 
Girdner [4], Reiman [5], and Stewart and 
Leland [7] covering various aspects of the 

> uas W - 
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finished designs. However, so far as can be as- 
certained no hypotheses have as yet been clearly 
formulated and tested. Kerr [3] has reported 
a validity study based upon the matchings of 
Mosaics with over-all personality descriptions 
but gives no indication as to the nature of the 
interpretive principles used. x 

The study reported in this paper represents 
an attempt to define objective scoring criteria 
for some aspects of the Mosaic Test and to ex: 
amine their validity. In order to avoid the 
ambiguities of definition involved in the study 
of psychiatric clinical groups, it was decided 
first to investigate the validity of the “organic 
signs” referred to above. In particular it was 
decided to examine the pattern characteristics 
described by Wertham. Organic impairment 
accompanying cerebro-azteriosclerosis was se- 
lected for study as this is regarded by Wertham 
as falling into both the cortical and subcorti- 
cal categories. r 

In pursuit of this aim it was necessary to es- 
tablish such accurately defined criteria that a 
trained observer might readily decide whether 
a given Mosaic production fell into the organic 
pattern or not. As written, Wertham’s defini- 
tions suffer from some vagueness. The criteria 
used in this study were therefore stated more 


specifically as deductions from Wertham’s — 


broader terms and based upon his examples. 
The most striking aspect of the cortical pat- 
tern is the failure to achieve a good configura- 
tion. The question of what is “good” or “bad” 
in configurations is predominantly a matter of 
judgment on the part of the observer and 
therefore subject to question. However, it is 
possible to obtain data as to whether or not 
a patient has, ir his own opinion, successfully 
completed a configuration. It was felt that the 
patient’s report as to his perceived success or 
failure to complete a configuration offered the 
best hope of objectifying this principle. This 
was so defined under criterion 2 ir the five 
criteria mentioned below. 


pend 
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With regard to the subcortical pattern, it 
can be seen that Wertham’s concept of “stone- 
bound” or stimulus-bound is essentially de- 
scriptive of a species of :perseverative response. 
However, it is possible for the subject to be 
bound to the characteristics of a stimulus in 
several ways. He may simply keep on placing 
Pieces of the same shape, or of the same color, 
or both, in direct contact with each other. Al- 
ternatively he may try to produce over-all a 
Mosaic which has the same Characteristics of 
form or color as its constituent pieces. Third- 
ly, he may perseverate at the level of repeating 
the process of putting pieces onto the tray with 
no discernible pattern and no continuity of 
Structure. Criteria 1, 3, and 4 below were 
formulated to categorize these three possibil- 
ities. Experience with the test also suggested 
that it would be essential to exclude “repre- 
sentative” Mosaics, even though they might 
Structurally meet the other criteria. By the 
term “representative” is meant any Mosaic 
which is intended to depict a concrete object, 
alphabetical or numerical symbol. Exclusion 
of this type of production was established as 
criterion 5, With this general rationale in 
mind the criteria were defined and used as a 

asis for the judges’ selection as described in 
the next paragraph. 


Method 


The writers administered the Mosaic Test 
to 54 residents ofa kome for the aged in the 
city of Chicago. A record was made at the 
time of administration of all verbal comment, 
Spontaneous or otherwise. The method of ad- 
ministration was the customary one wherein 
the Subject is invited to make anything he 
Wishes with the pieces on the tray. On comple- 
tion a brief inquiry was conducted to deter- 
mine what the subject had intended to make 
and whether he felt that he had been success- 
ul in his intention. The age of the group 
ringed from 64 to 91 years with a mean of 

‘6 years. All the subjects were volunteers 

© responded to a request for individuals to 
Cooperate in a study of aging. For. record pur- 
Poses the completed Mosaics were outlined 
and colored on the paper base. Tke records 
F the total group were then submitted to 
Ti of five psychologists on the staff ‘of the 

Nois Neurops ychietric Institute. Each judge 


was asked to sort the completed productions 
into two groups on the basis of the five criteria: 
one group to be those which met one or an- 
other of the criteria, and the other to comprise 
those productions which did not meet any of 
the criteria. The criteria, as indicated earlier, 
were: 


1. All designs or productions which consist of 
one or more single lines whether regular or irregu- 
lar as to shape or color of pieces used. 


2. All designs where the subject has failed in 
completing to his own satisfaction the design which 
he had stated he intended to make. This judgment 
involves reference to the verbal record sheet. 


3. All designs which are “homogeneous” as to the 
relation of the shape of the pieces used to the final 
production; e.g., a square made of squares. 

4. All designs in which pieces are simply placed 
side by side with no discernible over-all pattern, 
irrespective of shape or color of pieces used. 

5. A negative criterion. No successfully completed 
design which is of a representational character is 
to be included, even though it may fulfill one of 
the criteria, Thus a “square made of squares” 
would not be included if the subject had described 
it as a “tile floor” and had completed it to his own 
satisfaction. 

Of the 54 productions judged, a total of a 
were selected by the judges as meeting one 
or another of the criteria. Of this number, 20 
were chosen by all five judges. The seven am- 
big@ous cases were discarded from the sample 
leaving a further 27 cases which had been 
unanimously judged as meeting none of the 
criteria. There was therefore complete agree- 
ment on 87 per cent of the cases judged. 

Following the classification of Mosaics, 
reference was made to the results of the routine 
physical examination which had been given to 
these subjects by the institution physician. 
These examinations had been made before and 
independently of this study. On the basis of 
these records the suujec.s: were classified into 
those having recognizable signs of cerebral ar- 
teriosclerosis with deterioration and those not 
having such signs. Five of the cases in which 
the report was equivocal were discard-d. Those 
suvjects whose Mosaics had been discarded as 
ambiguous were also excluded, leaving ulti-, 
mately a total of 46 subjects, 20 of whom 
showed signs of cerebral arteriosclerosis. From 
the remaining 26, a further 20 having good 
health and most easily matched in mean age 
with the organic group were selected. The 
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matching achieved was as follows: The mean 
age of the organic group was 75.9 years, with 
SD of 7.3 years, and of the control group, 76.5 
years, with SD of 6.8 years. 

The groupings made by the judges were 
then analyzed with respect to the frequency of 
distribution of “organic” patterns in both 
groups. The “organic” Mosaic productions 
were then further subdivided into those judged 
as meeting criteria 1, 3, or 4, (the subcortical 
criteria) and those meeting criterion 2 (the 
cortical criterion). The results are given in 


Table 1. 


‘ Table 1 
Distribution of Mosaic Patterns in a Group of Aged 
A B Cc 
Group Criteria Criterion No 
1, 3, and 4 2 Criteria 
Organic 10 7 3 
Control 2 1 17 
x? 11.7 10.11 
vs. col C* p—.001 p=.0l 


* Chi square calculated using Yates’s correction. 


Discussion 


The levels of significance obtained support 
the inference that there is a meaningful rela- 
tionship between the presence of cerebral-ar- 


teriosclerosis, as judged by physical examina- _ 


tion, and the production of certain patterns on 
the Mosaic Test. In general the data support 
the clinically derived interpretive principles in 
so far as the criteria used in this study can be 
regarded as legitimate inferences from Werth- 
am’s rather broader definitions. However it 
should be pointed out that the criteria are not 
all derived from the same level of description of 
psychological events. Criterion 2 differs from 
the rest in that it is not confined to a description 


at 


of the structural’ features of the finished Mosa- 
ic production but deals rather with a failure in 
planning as reported by the subject himself. 
Influences covered by, the psychological con- 
cepts of level of aspiration, anticipation, and 
perhaps self-concept may be involved here. The 
relationship of organic disability to changes in 
these influences remains undisclosed by a study 
such as this. Nevertheless the clinician con- 
cerned with diagnostic problems rather than 
theoretical issues may find criteria drawn from 
several levels of description to be useful aids 
in his work. It is to this end that this report is 
primarily directed. The more fundamental im- 
plications for theories of perception and pro- 
jection remain problems for further investiga- 
tion. 


Received May 1, 1953. 
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Dating from Freud's work on dream analy- 
sis [1], and perhaps before, there has been 
Present in psychology and in psychoanalysis, in 
Particular, the working hypothesis that certain 
environmental objects stand in a symbolic re- 
lation to the male and female genitalia. 

As originally elaborated by Freud, the sym- 

glic relationship was based on certain struc- 
tural or functional similarities between the 
symbol and the genital organ symbolized. 

hus, elongated and pointed objects, such as 

Ives, telephone poles, chimneys, and noses 
Were assumed to represent the male genitalia, 
while round, containing objects, such as boxes, 

€y holes, houses, and ships were considered 
Symbolic of the female genitalia. 
Although White [6] has claimed that this 
Ypothesis is no longer in good repute, it would 
Seem instead that it has gained a wide, im- 
Plicit acceptance and has now become, for 
many, an integral part of their interpretation 
of projective materials ranging from figure 
drawings [5] to the Bender-Gestalt [4]. 
is is not to say that stereotyped interpre- 


i tations are necessarily made, or that the pro- 


uctions are considered out of context. In one 
case the absence of a chimney on a house, for 
example, may be said to indicate that the indi- 
vidual feels inferior to his father in terms of 
Power and authority while in another this may. 
© taken as a sign of feelings of sexual im- 
Potence, In either case, however, the object 
aS been assumed to have a certain fixed sym- 
lic relationship with reality, i.e., chimney = 
Penis, 
See Purpose of the present study is to in- 
Zate this hypothesized relationship. The 
YPothesis to be tested may be stated as fol- 


ows: a 7 
bri Where abstract objects are categorized 

tl a given means as- either male or female, 
Ose ob 


jects which may be described as elong- 
> Pointed, or angular will be categorized 


ated 


as male; those objects which may be described 
as round and containing in nature will be cate- 
gorized as female. 


Method 


The experimental design was developed with 
two factors in mind. The first was that the re- 
search was being carried on in a public school 
system where protest and resistance might be 
encountered should the purpose of the research 
be known. Secondly, from the standpoint of 
validity, it was felt that an indirect method of 
a projective nature would be less subject to any 
conscious resistances or anxieties which the 
subjects (Ss) might have concerning sex. Fur- 
ther, by using an indirect method it wag 
hoped that the hypothesis was being tested at 
the level at which it is assumed to be operating. 

The Ss consisted of 62 children, 30 male 
and 32 female, in the fifth grade of a public 
sbo in a community of 100,000 population. 
The Ss were divided into two groups, A and 
B, of 35 and 27, respectively. There was an 
equal proportion of males and females in each 
group. 

The hypothesis was tested by two ap- 
proaches, each designed to operate at a dif- 
ferent level of awareness. In the first ap- 
proach, Ss in both groups were told that the 
task they were about to perform was part of an 
investigation of immediate memory. The Ss 
were presented with a sheet of Paper on which 
ten first names were randomly listed, five of 
each sex. Below the list of names, ten figures 
were presented in random order. Five of the fig- 
ures,were elongated u- pointed and were there- 
fore assumed to be symbolic of the male genits! 
ia; fiv=were rounded and containing or symbol- ° 
ic of the female genitalia.1 The experiment was 
divided into three parts. During the first part 


*Copies of the figures are availabl- on request 
from the author. 
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Table 1 Table 2 
Predicted and Observed Frequency Distributions Comparison of Groups oh Retentich Scores 
H J. 
for Any Given Number of Correct Matches Groin N Meat SD 1 | 
Number of correct Predicted Observed A 35 5.7 1,907 1.384 
piafches 2 frequency frequency B 27 5.111 1.929 >.05 
0 -001 2 0 m g A 
2 -10 6.2 2 sume that if the hypothesis is valid, there ex- | 
4 .39 24.6 29 ists for the Ss a schema whereby there is a 
: 39 24.6 23 definite relationship between type of figure 
10 6.2 8 a ae A 5 
cuality. art two the learnin: 
10 al x and sexuality. Thus, in part tw E ú 


Ss were asked to assign one of the ten names 
to each of the figures, using each name only 
once. The sheets were then collected and Ss 
not adhering to the instructions were elim- 
inated from the study. 

The second part consisted of paired-asso- 
ciates learning. Ten flashcards each contain- 
ing one of the ten figures and one of the names 
were exposed for three seconds each in im- 
mediate succession. For Group A, the elong- 
ated and pointed figures were presented with 
male names, while the rounded and containing 

asfigures were shown with female names. For 
Group B, figures symbolic of the male genit- 
alia were presented with female names, and 
the female figures with male names. 


Part three consisted of a retention teat in 
which Ss from Groups A and B were asked, 
on the basis of the flashcards, once more to 
match symbols with names. Matching was 
done on blank sheets like those used in part one. 

The hypothesis being tested may now be 
stated in terms of the following prediction: 
1. In part one, matching of figures and names 
so that they are both of the same “sex” would 
be greater for the entire sample than that ex- 
pected by chance. 2. On the retention test in 
part three, Group A would show better re- 
tention than would Group B. 

The first prediction is based on the assump- 


tion that in any forced matching situation, ` 


those items perceived _as related in any fashion 
will be matched more urten than will items 
where there is no perceived relation if there 
are no instructions to the contrary. If the hy- 
pothesis being tested is valid, there should be 
certain regularly perceived relationships be- 
tween the figures and the names. 

In Bartlett’s terminology [1], one may as- 


of Group A may be considered as pro-schema 4 
learning and that of Group B, anti-schema i 
learning. The experimental design as a whole 
may be viewed as a study in negative and posi- 

tive transfer effects; hence the second predic- 
tion based on the assumption that Group A 
will be subject to positive transfer effects 
while Group B will be subject to negative 
transfer effects. 

Thus, while Ss may not associate names and | 
figures in part one as predicted owing to cer- | 
tain conscious inhibitions, if this association 
does exist it should affect the learning of the 
two groups in part twọ. 

i 


Results 


Since the first part of the experiment repre- 
sents a simple sorting situation, it is possible 
to test the null hypothesis by first calculating 
the probability of getting any given number 
of “correct” sorts, translating this into an 
expected frequency distzibuition for the experi- 
mental sample, and comparing this by means 
of chi square with the actual frequency distri- ~ 
bution. The results are presented in Table 1. < 

Chi square for this table is 4.714 which 
with 7 degrees of freedom is not significant 


„and therefore gives no reason for rejecting the 


null. hypothesis.? Hence, the first prediction | 
derived from the experimental hypothesis is 
not validated. 

| 


Table 2 presents the data on scores ob- 
tained on the retention test in phase three. The 
difference between the means of the recall 
scores for the two groups does not reach sta- /) 
tistical significance and hence fails to confirm 4 
the second prediction derived from the hy- 
pothesis. j i 
_7In calculating x? the two extreme categories at 
either end were combined beczuse of the low pre- 


f 
| 
dicted frequencies [3]. | 


AR 
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While the mean recall scores were not sig- 
nificantly different tor the two groups, there 
would still be some support for the hypothesis 
if the types of errors of recall made by the 
two groups wert different, i.e., if the errors of 
Group B could be shown to be due to intru- 
sions of previously determined associations be- 
tween type of figure and sex. An intrusion for 
Group B would be any error where the $ has 
matched a male figure with a male name and, 
female figure with female name. In other 
words, these are errors counter to training. In 
order to evaluate the significance of such in- 
trusions for Group B, it seems appropriate to 
Compare the percentage of their total errors 
due to such intrusions with the percentage of 
enrors made by Group A which were counter 
to training or “intrusions.” This is presented 
in Table 3. It will be noted that there is no 
difference between these two percentages. 


Table 3 
Analysis of Errors Made on Retention Test 
Number of 
Group Total number errorsdue % of total 
oferrors  tointrusions errors 
A 147 56 38 
B 132 50 38 
Discussion 


The results of this experiment do not lend 
any support to the hypothesis of sexual sym- 
olism as stated at the outset. While it is true 
that the results of this investigation should 
uot be generalized much beyond its experi- 
Mental population, its results do have broader 
Significance in so far as the proponents of uni- 
Versal sexual symbolism do not set any limits 
on its applicability. e” 
Since man is a symbol-using animal, it is 
quite reasonable to expect him to develop many 
Symbols related to sexuality. However, the re- 
a ts of this experiment would throw into 
E question the universality of his symbol- 
whi Blind analysis of projective ; materials, 
RS has become the current fashion, would 
so eed appear to be on tenuous grounds in 
oñe T as it' relies on hypotheses similar to the 
which was tested here. 


€ face validity and fenaciousness of the 
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hypothesis of universal sexual symbolism may 
be explained by several factors. The most im- 
portant perhaps is that the population out of 
which this hypothesis was derived was a 
treatment population for the most part. As 
such, it might be expected, first, that they 
would be more likely to have sexual problems 
and to utilize symbolic representation than 
would the general population, and second, 
should the therapist have certain preconceived 
notions concerning symbolism, it is quite likely 
that these individuals would be more suscept- 
ible to suggestion and hence provide the thera- 
pist with the validation he seeks. 

Further, because of the uncontrolled nature 
of the observations made by therapists as well 
as the likelihood of selective perception, it is 
quite likely that this is another example of the 
operation of partial reinforcement. 


Summary 


The present investigation was aimed at 
testing the hypothesis that certain environ- 
mental objects by virtue of their structurale 
characteristics may be taken as being symbolic 
of the male and female genitalia. The Ss used 
were normal children in the fifth grade of a 
public school. 

The hypothesis was tested by means of a 
simple matching situation and a learning situ- 
ation, both of which involved male and female 
first names and abstract figures conforming 
structurally to either the male or female sym- 
bol as described in the literature. In the first 
part of the experiment, Ss were asked to match 
names and figures, and in the second part they 
had to learn to associate certain names with 
certain figures. The latter represented essen- 
tially a test of positi.c zad negative transfer 
effects as would have been predicted by the 
hypothesis. 

The results of both parts of the experiment 
failed to lend support t^ the hypothcsis. The 
results were interpreted as evidence against the 
existence of a universal sexual symbolism. and. 
an indication of the need for extreme caution 
in the interpretation of symbolism and in 
blind analysis. 
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The Intetpretations of Anxiety by Various 
Psychotherapeutic Schools’ 


John H. De Michele 


Contemporary need for a briefer and more 
effective psychotherapy has led to many search- 
ing revisions of methodology. This trend can 
be seen in the works of Alexander and French 
[1], Horney [11], Mowrer [15], Rogers 
[18, 19], Thorne [21], and others. Valuable 
as this research is, the intensive study by each 
School of its particular techniques is a narrow 
approach to methodology. Since each school 
claims excellent results, it is possible that there 
May be common factors leading to this thera- 
Peutic success. An analysis by White [22], for 
example, found that although there are many 
Psychotherapeutic methéds, there are only five 
Processes or techniques common to all schools. 

n order to test this conception, studies com- 
Paring the various psychotherapeutic schools 
on these common basic techniques are needed 
and might prove fruitful. An encouraging be- 
ginning has been made in the realm of the 
Patient-therapist relationship by Fiedler [7], 
Heine [10], Miller [14], and Quinn [17]. 

Is patient-therapist relationship would ap- 
Proximate White’s first and fourth process, 
1%, rapport and transference. Fiedler, for ex- 
ample, found an optimal patient-therapist re- 
lationship basic and common to many schools 
oi Psychotherapy. Another basic method is in-- 
ci pretation. Although studies comparing the 
lative effectiveness of the various forms of 
ma shotherapeutic interpretation have. been 
vein by Grossman [8] and a few earlier in- 

gators [5, 9, 12], no studies have been 
schog nearing the various psychotherapeutic 
se. Th, on the technique of interpretation per 
Senti i basic technique of interpretation is es- 
ally White’s third process, called the 
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pointing out of feelings. This process has two 
forms: (a) the Rogerian recognition of feeling 
and (b) interpretation, which categorical as 
they are, White states, “are not sharply differ- 
ent from each other” [22, p. 345]. Now, Bor- 
din [2], Collier [6], and Stone [20] have 
suggested the very important point that we 
think in terms of a continuum along any basic 
method, i.e., that each therapist varies in the 
amount of development that he allows on the 
continuum of any basic method. Actually, there 
are many continua which can be found within 
any broad basic method. Collier, for example, 
proposes a continuum of “depth” of interpre- 
tation. The idea of continua is valuable, since 
it can lead to the possibility of measuring vari- 
ations within each of the broad basic methods. 
The comparative study of various schools of 
psychotherapy is valuable in that it can lead to 
the discovery of continua and the experimental 
testing of basic psychotherapeutic methods. 

In this study, interpretation has been selected 
for analysis. Interpretation may be defined as 
the inference by a therapist of the attitudes of 
a patient from cues supplied by facial expres- 
sion, posture, language, gesture, dreams, play, 
etc. The broad objective of the experiment will 
be to discover continua within the basic method 
of interpretation ; to discover quantitative vari- 
ations among the different methodological 
groups of therapists in terms of what is se- 
lected to substantiate an inference, and how 
they arrive at an interpretation. 


à ‘ 
The Criterion 


In stder to carry out the broad objective of * 
this study, the criterion selected for interpre- 
tation should be as definitive as possible. An 
intense degree of anxiety was selected as the 
criterion, because its somatic manifestations are 
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directly observable physiological reactions. The 
term anxiety is used to represent all of its 
forms, i.e., anxiety neurosis, prodromal anxiety, 
normal anxiety, or fear, since the symptoms are 
the same. While differences between these 
forms may be inferred or observed situational- 
ly, internally, or in terms of feelings, Brown 
[3, p. 131] and May [13, pp. 190, 203] agree 
that the directly observable symptoms are the 
same. A subsidiary objective of the experiment 
will be to determine which of the most common 
directly observable symptoms are used to sub- 
stantiate an inferred intense degree of anxiety. 

From the most complete list [4, p. 48] of 
anxiety symptoms available, a selection of di- 
rectly observable symptoms was made. To 
these were added difficulty in sleeping, because 
its effects can be noticed, and fear, because its 
intimate relationship should have the highest 
correlation with anxiety. The symptoms se- 
lected were as follows: 


1. Jumpiness to slight sounds, lights, ete. 
2. Great tension. 

3. Agitation to the point of trembling. 

4. Great difficulty in breathing. 

5. Profuse sweating. 

6. Sleeps very poorly. 

7. Great fear. 

8. Great difficulty in concentration. 

9. Great difficulty in speaking. 


The Media 

Since the symptoms of anxiety are directly 
observable, and since the inference of anxiety 
is essentially the judgment of an emotional ex- 
pression, 10 pictures of people showing various 
degrees of emotional expression were selected 
as vehicles which might be conducive to infer- 
ring anxiety. The pictures ranged from nonde- 
scriptive expressions to intense expressions 
suggestive of fear, anxiety, or terror. The pic- 
tures with the intense emotional expressions of 
fear were selected on the basis of similarity to 
the typical ones used in earlier studies con- 
cerned with the judgment of emotion [16, pp. 
365-365]. Each pict~re was of one person in 
a relatively vague background, so that little 
could be inferred from the situational gontext. 
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The Preliminary Experiment 
A preliminary experiment was conducted for 
two purposes: (a) to see if judgment of the 
symptoms of anxiety has a good correlation 
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with a judgment or inference of anxiety, and 
(4) to see if the expected’ range of emotional 
expression, subjectively selected by the criteria 
of facial and postura: expressions of emotion, 
is as diverse as the measured range of the emo- 
tional expression suggested by the pictures. 

A group of 17 psychologists, composed of 
clinicians from the Veterans Administration 
Hospital at Downey, Illinois, and counselors 
from the Chicago Undergraduate Division of 
the University of Illinois, was selected for the 
preliminary experiment. 

Each psychologist rated the selected symp- 
toms of anxiety arranged in five-point scales 
for each of the 10 pictures shown. He then had 
to rate anxiety and two other clinical syn- 
dromes on similar five-point scales. The median 
rating was found for each of the 10 pictures, 
and each was correlated by Spearman’s rho 
with the median anxiety ratings for each of 
the 10 pictures. The correlation coefficients for 
each symptom with anxiety ranged from .35 
to .89. The mean of all’of the median ratings 
was found and correlated .87 with anxiety. 
We can conclude from the evidence that cli- 
nicians who rate these symptoms high tend to 
rate anxiety high, 

The only quantitative indication that the 
emotional expressions of the persons shown in 
the pictures are well dispersed is the median 
Score of the amount of anxiety seen by the 
clinicians in each picture. Pictures 2, 6, and 
10 were always judged to have a low degree 
i anxiety, while picture 1 was always judged 

9. have a high component. Pictures 4 and 9 
were judged to have a hi 
two out of three times, 
and 8 varied within t 
scale. 


while pictures 3, 5, 7, 
he middle area of the 


Methodological Types of ‘Therapists 


Two distinct methodological schools may be 
identified as Rogerian psychotherapy and 
Freudian psychonanalysis. Adherents of these 
schools should show the greatest methodologi- 
cal consistency. The “eclectic” psychologists 
and psychiatrists, although each has a distinct 
training, are less homogeneous. The groups 
used in this study consisced of 10 Rogerian 
psychotherapists from the Counseling Center 
of the University of Chicago, 10 psychoanalysts 
who were trained at the Ch’cago Institute of 


gh degree of anxiety. 
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Psychoanalysis, 6 eclectic psychologists, and 
5 eclectic psychiatrists. An effort was made to 
select the most efficient and experienced thera- 
pists; five years of therapeutic experience was 
generally requiréd. 


Procedure 


The pictures showed a person expressing 
some degree of a feeling, just as a person 
might in a face-to-face therapeutic situation. 
In section 1 of the directions, the therapist was 
asked to infer what he thought the person in 
the picture was feeling. In section 2, the thera- 
pist was then asked what in the picture led 
him to his impression; he was further asked 
what other signs, cues, or symptoms he would 
expect the person to display. In the case of 
anxiety this procedure led to a selection of the 
most diagnostic signs that each therapist uses 
to infer anxiety. Section 3 of the directions 
consisted of rating the signs in terms of the 
Magnitude of their contribution to the major 
Impression, but this rating was not too success- 
ful. After all of the pictures had been com- 
Pleted, section 4 of the directions was pre- 
sented ; here the therapists had to classify each 
of the reshown pictures into one of four affec- 
tive states: (a) normal, (b) neurotic, (c) 
Psychotic, and (d) anxiety. In addition, he had 
to rate each of these states in terms of intensi- 
ty, from 1 to 4. Section 4 was of value in two 
Ways: first, to check the consistency of the 
therapist. If he sw® anxiety in the initial 
Inference he should also see it in the final 
Classification ; and second, to check the relative 
Intensity of the anxiety classification. ; 

The order of presentation was maintained 
constant, and the therapist had to comply with 
at least sections 1 and 4 of the directions. Each 
therapist had to write his own test. The time 
&lven to the administrator by the therapist was 
of major importance in the flexible use of the 
ther two sections of the directions. Under 
Pressure of time, only the material directly re- 
ating to anxiety was completed. The thera- 
Plsts Were especially urged to do their best 
When they inferred anxiety. 


Qualitative Results and Observations 


: Most of ‘the therapists were cooperative, in- 
pasted in the test, and readily made available 
“r facilities. Many psychoanalysts, however, 
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were rather defensive. The writer found many 
interesting reactions. Some therapists were 
efficient and quickly understood the directions ; 
others had to have the directions read over and 
over again. Two therapists apparently experi- 
enced anxiety reactions when they could not 
cope with a picture. These therapists could not 
go on with the test and appeared very agitated ; 
one perspired freely, while the other had to 
leave the room for a smoke to settle his nerves. 
Some therapists thought the test was difficult, 
others thought it simple. As a whole the thera- 
pists disliked the idea of writing the test and 
would have preferred a recording machine. The 
protocols of many therapists showed conflicts, 
and some stated that the test was a “personal” 
experience for them. 


A sample of an excellent handling of the criterion 
in picture 1 by an eclectic psychologist is shown in 
the following protocol: The woman is distressed and 
frightened by something which she sees happening 
at her right. She is clutching her coat (1), has a 
puckered brow, and a tense anguished expression 
about the mouth (1). If one could see this woman 
through time, i.e., in motion, she might be restless 
or more or less frozen. One might expect explosive, 
behavior, a sudden decision to do some particular 
thing. She would be inclined to vocalize, breathing 
would almost certainly be disturbed (4); there 
might be anomalies of perspiration, e.g., (cold per- 
ong (3); there might be a high degree of 
concentration, preoccupation (2). If someone spoke 
to her she would either not hear them, perhaps be 
petulant, or turn eagerly to them. (D-3) 


In order to typify the group’s approach, the 
following examples of picture 1 are presented. 


A Rogerian therapist’s protocol, typical of the 
group, is as follows: “I think she is in real emotion- 
al distress, with fear and pain as her prominent 
feelings. Cues: the knotted brow (2), the clenched 
hand (1), muscular strain on the face (3). I would 
expect weeping, very likely sobbing to follow if she 
started to explore her iniiags.” (D-4) 

A typical eclectic psychologist’s protocol is as fol- 
lows: “A reaction of panic, consisting of fright, 
sorrow and anxiety. She is immobilized as far as 
reacting is concerned (4). Facial expression (2) 
and position of the hand 41); general isapression 
that’ she is viewing something in the distance (1). 
She feels numb and cold and at the same time 
agitatea (1). Her face is hot and she is perspiring. ~ 
(1) Her mouth is dry and her heart is pounding. 
(1) Tears are about to come.” (D-4) 

A typical analyst’s protocol is as follows: “Ap- 
parently a frightered woman — look» unhappy — 
and some pain I feel from internal sources; (4) 
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the painful expression of the eyes, (3) hand 
clutched to the coat, (1) mouth open. She seems to 
be looking at something which gives this reaction 
of fright — she might next turn away. However 
I’ve seen psychotic patients on walks react like this 
from no external stimuli. Accounting for my first 
impression above. Also there is a pseudo-quality or 
an overreaction of pain which vanished quickly 
and the patients appeared more relaxed following 
it. She may cry from this point on; (1) lower her 
head, (2) turn her head, (3) show beads of per- 
spiration.” (D-4) 


Quantitative Results 


Inference from subjective feelings. This fac- 
tor appears to lie on a continuum which has 
crude quantitative verification. When the test 
was being administered to analysts, the writer 
became aware of an involved “soul searching” 
to find cues to substantiate their inferences. On 
the other hand, the Rogerians and eclectic psy- 
chiatrists overtly seemed little involved. Some 
therapists felt so strongly about this internal 
source of cues that they had to write them 
down. When a therapist is so aware of his 
feelings as cues, we could expect a different 
e™kind of interpretation than from a therapist 
who objectifies the problem. The protocols 
show four analysts, two eclectic psychologists, 
one Rogerian, and no eclectic psychiatrists 
who used these internal sources as cues. de 
as this evidence may be, it certainly should be 
investigated further. 


Inference of pathology. The results from the 
classification of affective states under section 4 
of the directions was arbitrary and in many 
cases unsatisfactory; yet a scrutiny of the re- 
sults showed a wide difference in classification 
by the different groups. A dichotomy of the 
classifications was made between the normal 
and the three abnormal affective states. The 
analysts inferred the least amount of normal- 
ity in the set of pictures, and conversely the 
greatest amount of pathology. The Rogerians 
and the eclectic psychiatrists inferred the least 
amount of pathology, while the eclectic psy- 
chologists lie in between’ the two poles. “he 
significance of differences between the mean 

- amount of pathology inferred by the jsycho- 
therapeutic groups was found with the Mann- 
Whitney U Test. The results can be seen in 
Table 1. 


The inference-cue ratio. The inference-cue 
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Table 1 
Significance of Differences between Psycho- 
therapeutic Groups on the Inference 
of Pathology 
(Using the Mann-Whitney U Test) 


Groups N U,U-zscore p 
1. Rogerians and analysts 19 (U-z) 2.82 .005 
2. Eclectic psychiatrists and 
analysts 15 (U-z) 2.82 ..005 
3. Eclectic psychologists and 
Rogerians 15 (U-z) 1.97 .05 
4. Eclectic psychologists and 
eclectic psychiatrists 1t (U) s5 08 
5. Eclectic psychologists and 
analysts 16 (U-z) 1.29 NS 
6. Eclectic psychiatrists and 
Rogerians 14 (U-z) .60 NS 


ratio is the number of inferences made as com- 
pared to the number of cues used to support 
these inferences. For example, if a therapist 
makes four inferences and uses only two cues 
to support his inferences, then his inference- 
cue ratio would be four divided by two, or 
two. Two inference-cue ratios were found. The 
first ratio was the number of inferences made 
under section 1 of the directions to the number 
of cues selected from the picture. For the 
second ratio, the expected or inferred cues, 
signs, or symptoms were treated as inferences; 
thus, this ratio was the number of inferred 
cues to the number of cues selected or observed 
in the picture. The inferénce-cue ratios were 
all made on picture 1, which was completed by 
all therapists, and upon which the directions 
were best controlled. Table 2 shows the in- 


Table 2 
The Inference-Cue Ratios of the Psychotherapeutic 

Groups 

Eclectic Eclectic 
Ther- Rogerians psychi- psychol- Analysts 
apists atrists ogists 
I/C*IC/C*I/C IC/C T/C IC/C I/C Ic/c 

1. 0.5 00 08 18 25 40 1.8 00 
2 10 08 15 11 10 08 20 3.0 
3. 12 00 10 17 11 1.0 0.5 1.5 
4 08 00 11 00 .10 40 10 23 
5. 06 06 10 20 08 00 13 2.0 
6 10 0.6 0.7 2.0 2.0 2.0 
7. 1.0' 0.0 , aS 13 
8 10 0.0 27 13 
9% 23 1.6 4.0 3.0 


* I — inferences, IC — inferred eres, C — cues. 
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Table 3 
Significance of Ditferences between Psycho- 
therapeutic Groups on the Inference-Cue Ratios 
(Using the Mann-Whitney U Test) 


Groups œ% N U, U-z score p 


1. Rogerians and analysts 18 


I/C ratio* (U-z) 1.94 .05 


IC/C ratio* (U-z) 2.74  .006 
2. Eclectic psychiatrists and 
analysts 14 m 
I/C ratio (U-z) 1.58 NS 
IC/C ratio (U-z) 1.03 NS 
3. Eclectic psychiatrists and 
Rogerians 14 
I/C ratio (U-z) .66 NS 


IC/C ratio 
4. Eclectic psychologists and 


(U-z) 2.05.04 


o Rogerians 15 
‘I/C ratio (U-z) .35 NS 
IC/C ratio (U-z) 2.13 .03 
5. Eclectic psychologists and 
eclectic psychiatrists 11 
ratio (U) 13 ps 
IC/C ratio (U) 17 0g 
6. Eclectic psychologists and 
analysts 15 
/C ratio è (U-z) 1.53 NS 
IC/C ratio Ua) A7 NS 
er 


~ inferences, IC — inferred cues, C — cues. 


ference-cue ratios of the various psychothera- 
Peutic groups. 

From the inference-cue ratios of Table 2, 
We can observe a progression from the Roger- 
‘ans, who clearly showean extreme reluctance 
to infer or interpret at all, to the analysts, who 
interpret most from the cues they selected from 
the picture. This progression is an indication 
ef the “depth” of interpretation continuum. 

€ significance of difference of the two in- 
Crence-cue ratios was found between the vari- 
ous Psychotherapeutic groups; the results can 

© seen in Table 3. 
ther °sological orientation. For each group of 
“pists, the number of consistent inferences 
anxiety was found, i.e, where anxiety or 
Y Was inferred in section 1 of the directions 
or bo. in section 4 with a rating of D-3 
ferences Ten analysts gave 21 consistent in- 
While oe anxiety throughout the 10 pictures, 
Consiste  Rgerians at the other end gave 8 

i a E inferences of anxiety. The ratio of 
Compared er of times each symptom is used 

cd to the pumber of consistent anxiety 


fea 


inferences made by each group may be ex- 
pressed as a percentage. This percentage shows 
how often a particular symptom is used to sup- 
port a consistent inference of anxiety. In addi- 
tion, Table + shows which symptoms are used 
most often by the various groups to substantiate 
their inferences of anxiety. 


Table 4 
Percentage of the Symptoms of Anxiety Used to 
Support a Consistent Inference of Anxiety 


Eclectic Eclectic 


Symptoms psy- psy- Roger- 
chia- cholo- ians 
trists gists 

1. Perspiration 57.1 714 33.3 0.0 
2. Breathing difficulty 28:5 SAI 25 0.0 
3. Immobility 14.3 143 33.3 0.0 
4. Vasomotor difficulty 14.3 28.5 8.3 0.0 
5. Tension 9.5 85.5 33:33 0.0 
6. Pupils dilated 9.5 28.5 0.0 0.0 
7. Confusion 4.8 143 8.3 0.0 
8. Exhaustion 14.3 14.3 16.6 0.0 
9. Rectal urgency 4.7 143 0.0 0.0 
10. Pilomotor reaction 0.0 14.5 0.0 0.0 
11. Speech dificulty 0.0 14.3 8.3 0.0 
12. Vomiting 4.7 0.0 0.0 0.0 
13. Nervous movements 9.5 14.3 0.0 0.0 
14. Collapse 9.5 14.3 0.0 0.0 
15. Flight 19.0 28.5 16.6 12.5 
16. Cryout or tears 28.5 57.1. 25.0 25.0 
17. Gross body movements 47.6 0.0 0.0 62.5 


oy 


The eclectic psychiatrist, whose training is 
heavily weighted with nosology, would prob- 
ably substantiate an inference of anxiety with 
cues which are more nosologically oriented 
than would the Rogerian, who at the other 
extreme has little interest in nosology. A con- 
tinuum in terms of nosological orientation has 
some experimental confirmation. There is a 
progression of the number of nosological symp- 
toms used, extending from the analysts and 
eclectic psychiatrists at one end to the Roger- 
ians at the other. None of the Rogerians in- 
ferred any of the nosological symptoms of anx- 
iety, but instead they used gross bodily move- 
ments descriptive of the startle pattern. Whe in- 
ferred or expected cues used were crying, 
screaming, expressing concern, and movements 
away or toward the anxiety-producing object. 


Summary and Conclusions 


The aim of this research was an attempt to 
compare the various psvchothzrapeutic schools 
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on the basic method of interpretation. Ther- 
apists were to interpret anxiety from pictures 
showing various degrees of emotional expres- 
sion. The results were analyzed qualitatively 
and quantitatively. Four continua in the basic 
method of interpretation were postulated from 
the results of the experiment. These continua 
are tentative and need more refined experi- 
mental substantiation. The four continua are: 


1. “Depth” of interpretation 

2. Nosological orientation 

3. Inference of pathology 

4. Inference from subjective feelings 


Received June 8, 1953. 
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The hypotheses of this study are two: (a) 
when operational definitions of projection, em- 
Pathy, and reality are given, projection will be 


» Negatively correlated with both reality and 


empathy, whereas empathy and reality will be 
Positively correlated with each other; and (4) 
reality and empathy will correlate more close- 
ly with adjustment than will projection. 
Regarding the first hypothesis, Allport [2], 
ealy, Bronner, and Bowers [12], and Sears 
[15] state that projection can occur provided 
the individual lacks insight into himself. But 
Self-insight requires a degree of realistic per- 
Ception of oneself. Steinmetz [16] expands the 
Concept of insight to mean the ability to per- 
Ceive the world as others do. In either case, 
it may be stated, as does Alexander [1], that 
Projection involves a lack of reality testing. He 
Says, using projection of hostility as an ex- 
ample, “If this hostility becomes conscious it 
Would cause guilt and, anxiety, and to avoid 
this the whole situation may be distorted by 
Saying, ‘I do not want to attack him; he wants 
tg attack me.’ Such distortion of reality be- 
Coines possible only when the ego renounces its 
Contact with reality under the pressure of emo- 
tional needs” [1, p. 114]. Thus, it may be 
Postulated that a negative relationship exists 
etween projection and realistic perception or 
Teality, 
qu Projection is also negatively related to 
Gant and that empathy is positively re- 
prey; to reality may be inferred from logic and 
abe’ research. Certainly, empathy, or the 
wa to put oneself in another’s, place, re- 
a Tealism in seeing others. Dymond [6] 
lated oe that insight and empathy are re- 
Fore. each other, ‘and Norman [13] has 
Ships Strated that there are positive relation- 
among variables he terms insight, self- 


other identity, and realistic perception of 
others. As part of the first hypothesis, then, it is 
the intention of this study to confirm these 
findings by Dymond and by Norman, using an 
entirely different technique. It may also be 
logically inferred that if reality and projection 
are negatively related, and if reality and em- 
pathy are positively related, then empathy and 
projection should be negatively related. 

Regarding the second hypothesis, it may be 
predicted that adjustment should be more 
closely tied to empathy and reality than to pro- 
jection. Projection is a defense mechanism of 
the ego and inherently implies maladjustment €> 
and insecurity, according to Bellak [3]. It is 
also prominent in paranoid maladjustment, as 
is well known. Moreover, Dymond [8] found 
thataindividuals who possess empathic ability 
are better adjusted and more secure than those 
who do not. Norman [13], using sociometric 
data of acceptance, found positive relation- 
ships between acceptance and self-other identi- 
ty, insight into self, and realistic perception of 
others. 

Subjects and Procedure 


The Guilford-Martin Inventory of Fac- 
tors GAMIN [11] was given to 74 male col- 
lege students, most of whom were freshmen. 
This inventory was checen because it is easy to 
administer, was standardized on students, and 
has high reliability. Particularly, the fact that 
the test has been factor analyzed is especially 
advantageous to this study because of interest 
in the operation of the various experimental 
variables (empathy, projection, and reality) 
with traits of high factorial validity. Guilford 
and Martin [11] state that the intercorrela- 
tions between the traits are generally low 
enough to assure useful differences in measure- 
ment between the trait scores. By giving the 
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test in two forms, scores for our three experi- 
mental variables were obtained. The first form 
was administered as usual except that the “?” 
alternative in answers was omitted. The sub- 
jects thus had to answer either “Yes” or “No.” 
Two weeks later, a second test was given to 
the same subjects, and, instead of answering 
for themselves, subjects were required to 
answer the questions as they thought most 
others of their own age and sex would answer 
them. For example, Question 8 on the original, 
“Do you feel that people almost always treat 
you right?” was changed to read, “Do you 
think that most people of your own age and sex 
feel that people almost always treat them 
right?” It was felt that there would be more 
uncertainty in answering questions for others 
and therefore that too Many question marks 
would be used. The test would then be too dif- 
ficult to deal with for our Purposes, and it was 
for this reason that “ P” was omitted from both 
forms. 
Projection. From statements in the litera- 
ture [1, 2] projection may be defined to in- 
em clude the following aspects: (a) it is defen- 
sive; (b)it is unconscious; (c) it involves un- 
desirable characteristics which threaten the 
ego; (d) it occurs when th 


on, as follows. The 


, in answering the first form (about 
himself) denies that he 


trait. On 


tirely possible that others do possess it, and 
that he is realistic about others and is not pro- 
jecting. He is projecting if the majority (51% 
or more) of the group, in taking the test for 
themselves the first time, say that they do not 
have the trait in question. In other words, if 
the subject says, “I don’t have this, but others 
do,” when actually the majority of others say 
they de not, then prejection is occurring. This 
procedure was done only for these questions 
which involved undesirable traits since-hy defi- 
ition projection involves undesirable charac- 
teristics which the subject cannot repress and 
against which he unconsciously defends him- 
self. He is-being unrealistic in attributing the 
trait to others when they say they do not pos- 


„between this type of tran 
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sess the trait. This appreach is supported by 
Remmers [14] who, in defining projection, 
says that if operationally there is a significant 
difference between the actual measurement of 
the characteristic and the estimate given by 
the subject then projection is operative. — 
Each subject was given a point for projection 
each time he answered a question according to 
the above formula. Total scores on projection 
were obtained «for only three of the GAMIN 
factors—A, I, and N. Trait A is ascendancy in 
social situations as opposed to submissiveness ; 
I is lack of inferiority feelings or self-confi- 
dence; and N is lack of nervous tenseness and 
irritability. Guilford and Martin state that 
high scores on G, A, I, and N mean generally 
unfavorable characteristics and low scores 
mean favorable characteristics [11]. How- 
ever, G (general pressure for activity) may 
possibly be equivocal for this study, since it 
measures either a tendency to engage in vigor- 
ous overt action or a disinclination for motor 
activity. Likewise, trait M (Masculinity) may 
be equivocal since a high degree of femininity 
is to be expected among college males [5]. 
Therefore, G and M were not used, since they 
are not as ego-involved as A, I, and N. 
Empathy. Dymond [6, 7] defines this as an 
imaginative transposing of oneself into the 
thinking, feeling, and acting of another, and 
with Cottrell [4] she says it means to take an- 
other’s role, place oneself in his shoes, and per- 
ceive the situation from his perspective. Gross- 
man [10] refers to it as perceiving correctly 
the world from the other Person’s frame of 
reference. This perhaps involves Projection in 
that one Projects oneself into the thinking, 
feeling, and acting of another, The difference 
sposition and true pro- 
jection lies in the realistic nature of empathy, 
Remmers [14], as noted above, has said that 
operationally if there is a significant difference 
between the actual measurement of the ch 


of the characteristic and 
given by the subject are the same, 
then it is empathy. Thus it can be seen that 
empathy’ requires a realistic estimzte of others 
whereas Projection does not. The difference 
then between the drojectios, which occurs in 
empathy and Projection as defined for this study 
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lies in the fact that in empathy the projection 
is one which is a true estimate. This reasoning 
is further justified by the fact that Sears [15] 
found that those who project lack insight, and 
Dymond [6] says that those who are empathic 
have insight, for to possess insight implies a 
realistic view of oneself and others. 

Thus the operational definition for empathy 
used here is as follows. An individual em- 
Pathizes when he says others pogsess a trait in 
question and others actually do have it when 
Speaking of themselves. In other words, the 
subject in taking the second form of the test 
Says that others possess a trait; if the majority 
(51% or more) of the group, in taking the 


test for themselves (first form), agree with 


im, then it may be said that empathy is oc- 
curring. One point for empathy was given each 
time the subject answered a question according 
to this formula. There is then, as Remmers 

Says, no difference between the estimate 
°F the measurement of others and the actual 
Measurement of others. 
gee Realism or reality may be used in 
tes ways, i.e., a realistic outlook may imply 
Ge i le individual looks at himself realistically 
this ethe looks at the world as others do. For 

study, as did Norman [13], we chose the 
S a aspect, a comparison of the individual’s 
of rss of others with the group’s estimate 
insi wa The term as used here has been called 
en Mt by others. Steinmetz [16], in an objec- 
to Study of insight, hasdefined it as the ability 
sae the world as others do. Thus the 

‘ oo reality in the present study could 

oF i Insight since there is a comparison of 

es e€ individual’s perception of others con- 
S to the group’s perception of others. 

Sea it has been shown [1, 6, 7] that 
tion : only one aspect of insight, for in addi- 

o, j 9 being able to look at the world as others 

. insight means being able to look at oneself 
ate Thus it was decided that a more 
reality. ¢ term for the present measure was 
ality 5 Operationally in this study, then, re- 
have Pras when the individual states others 

© trait in question and ethers actually 
others. 3 It when the group is, speaking „of 
the Se Pecifically, the subject in answering 

“ond jorm (about others), says they 
2 certain trait; the majority of the 

% or more) when taking the second 
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form, also say that others possess the trait. The 
subject is then being realistic, i.e., he is seeing 
others as others see others — there is a con- 
formity between the subject’s and the group’s 
estimate of others. He is given a point for 
reality each time this occurs. 

For both total empathy and reality scores, 
all the questions for factors A, I, and N were 
used, since it is possible to empathize and be 
realistic on both desirable and undesirable 
traits. Also it was possible to obtain a score 
for both empathy and reality on both “Yes” 
and “No” answers, which was not possible 
with projection. 

In testing the first hypothesis, it was neces- 
sary to beware of the fact that spuriously high 
correlations could result from intratrait com- 
parisons. As noted above, projection scores 
were derived partially from the first form of 
the test when the group as a whole took the 
test answering for themselves. Empathy scores 
were also partially derived from this measure. 
Therefore, high intratrait correlations might 
result because both projection and empathy 
scores were derived from the same base. For 
example, high relationships might occur when 
relating A empathy to A projection, I em- 
pathy with I projection, etc. Hence, intertrait 
relationships must be examined, correlating 
everyQvariable with every other. Therefore, A 
projection was correlated with I projection, I 
reality, I empathy, N projection, etc. Then, if 
significant correlations occurred between any 
variable derived from one trait and that de- 
rived from another, a further check on the 
first hypothesis could be offered. In addition, 
although this was not stated as a hypothesis, it 
could be empirically determined whether, if 
an individual projected in one trait, he would 


` project in another, or if he were realistic in one 


trait, he would be realistic in another, etc. 

To examine the first hypothesis, then, scores 
in projection, empathy, and reality were inter- 
correlated for both intertrait and intratrait 
comparisons. To test the second hypothesis, that 
reality and empathy would be positively cor- 
related with aujustment, correlations were de- 
rived ‘between scores in reality and empathy 
for traits A, I, and N, and actual test scores! 

1These scores, of course, do not represent com- 
pl.tely the scores the subject would have made had 


he been allowed the- “?” alternative in“answering 
the questionnaire the first_time. . 
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obtained for these traits. The actual scores 
were the operational measures of adjustment. 
The hypothesis was first entertained that pro- 
jection would correlate negatively with adjust- 
ment. This was not entirely tenable because it 
is obvious that in scoring a test like GAMIN, 
when a subject denies undesirable traits in him- 
self, he obtains a better “adjustment” score. 
This is correct, because all intratrait correla- 
tions, as shown later in Table 3, have a posi- 
tive r between projection and adjustment, a re- 
sult which may be an artifact of the scoring of 
the test. 
Results 
Tables 1 and 2 present correlations testing 


the first hypothesis. Table 1 shows that all 
intratrait correlations are significant at the 1% 


Table 1 


Intratrait Correlations among Experimental 
Variables 


Relationship r 


A projection vs. A reality 


—.35e° 
A projection vs, A empathy —41% 
A reality vs. A empathy 740% 
I projection vs, I reality — 450 
I projection vs, I empathy — 6558 
I reality ys. 1 empathy 839° 
N projection vs. N reality —Noss 
N projection ys, N empathy —.66%* 
N reality ys. N empathy 894 
Total projection (A +1 +N) 

vs. total reality (A + I -+ N) —.41%* 
Total projection (A +I +N) 

vs, total empathy (A + I + N) —.659* 
Total reality (A + I+ N) 

vs. total empathy (A +1 +N) .77** 


** Significant at the 1% level. 


level in the predicted direction. The median 
of the three intratrait correlations (excluding 
total scores) between projection and reality is 
—.45; the median of the 3 r’s between projec- 
tion and empathy is, —.65; and the median of 
the 3 r’s between reality and empathy i3 .83. 
Using total scores, these medians are re- 
spectively —.41, —.65, and .77. Regarding 
intratrait correlations, then, it may be seen 
that the first hypothesis is readily supported. 
However..as noted above, these r’s may have 
an element of spuriousness to them. Table 2, 
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which shows intertrait correlations, presents 
the following data. There are six correlations 


Table 2 

Intertrait Correlations among Experimental 
Variables 

Relationship r 


A projection vs. 


I projection doe? 
I reality —.03 
I empathy —,23* 
N projection 411 
N reality Si 
N empathy — .22 
A reality vs. 
I projection —.17 
I reality r o 
I empathy 30%" 
N projection —.14 
N reality .26* 
N empathy .25* 
A empathy vs, 
I projection — 5h 
I reality 30°" 
I empathy : 50%% 
N projection —.23* 
N reality +16 
N empathy 26" 
I projection vs. 
N projection i5700 
N reality —.29* 
N empathy se 
I reality vs. a c 
N projection —.13 
N reality n 49%" 
N empathy 37%% 
I empathy vs. a 
N projection —.49** 
N reality 39%" 
N empathy 52%% 
eee 


Significant at the 5% level. 
** Significant at the 1% level. 


between projection and reality, with a median 
of —.16, which is not significant. Only one of 
these six correlations is statistically significant, 
but all are in the direction predicted. Between 
Projection and empathy, there are also six cor- 
relations, with a median of —.29, significant 
at the £% level. Five of these six correlations 
are statistically significant, and all six are if 
the direction predicted. Retween reality and 
empathy, there are again six correlations, the 


r 


jai! 
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median of which is .30, significant at the 1% 
level. Again; five of these six r’s are statistically 
Significant, and all are in the direction pre- 
dicted by the hypothesis. Of the total of 18 
Intertrait r’s, all br 100% are in the indicated 
direction; 11 or 61% are statistically signifi- 
Cant either at the 1% or 5% level, a figure 
which far exceeds chance expectations. The 
first hypothesis is thus supported by data from 
both Tables 1 and 2. ə 

Each of the variables also correlates well 
with itself, according to Table 2. The median 


Table 3 
Correlations between Adjustment and 


Relationship r 


O l ke 


A adjustment vs, 


A projection 435e 
A reality = 
A empathy <27* 
Projection En 
I reality na 
I empathy A 
Projection i oe 
N reality pa 
N empathy pa 
I Adjustment ys, 
A Projection ae 
reality h 
A empathy iy 
I projection a 
reality e eo 
I empathy a 
Projection ae ig 
reality 
N empathy A 
N adjustment ys. 
A projection 3 
reality za 
A empathy sg 
Projection = 
I reality ast 
I empathy ci 
Projection 4 
N reality a 
N empathy | ae 
Total adjustment (AIN) VS. x 
a Projection (AIN) T 
Tal reality (AIN) ce 
otal empathy (AIN) =. 


* 
Signi 
+. nificant at tle 5% level. 
nificant at the 1% level. 
A 
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of the three correlations of projection in one 
trait with projection in another is .50, signifi- 
cant at the 1% level. The median of the three 
r’s of reality with reality is .48; of the three 
rs of empathy with empathy is .50. Both 
these r’s are significant also at the 1% level. 
Thus it may be stated that if an individual 
projects in one GAMIN trait, he will project 
in another, if he is realistic in one he will be | 
realistic in another, etc. 

The second hypothesis stated that reality 
and empathy will correlate more closely with 
adjustment than will projection. Data bearing 
on this hypothesis are presented in Table 3. 
In this table, the median intratrait r of the 
three correlations between projection and ad- 
justment is .13 (that all three are positive may 
be an artifact of scoring the GAMIN, as 
stated before). The median of the three intra- 
trait r’s between reality and adjustment is .21; 
the median of the three between empathy and 
adjustment is .38. Only the latter median 
figure is statistically significant, but the order 
is in the direction of our hypothesis. Projection 


and adjustment give one rather high statistical- <= 


ly significant r of .43, for trait A. Since all of 
our subjects were males, it is perhaps expected 
that denial of lack of ascendance would be 
important. Reality also has one statistically 
ies intratrait r with adjustment, but 
empathy correlates significantly in all three in- 
stances. Using total scores, the r of total ad- 
justment on traits AIN with total projection 
on these traits is .18, with total reality it is 
.46, with total empathy it is .56. The latter 
two are significant at the 1% level. 


If we examine the intertrait r’s which are 
free of contamination, it will be noted that 
the median r between projection and adjust- 
ment is just about .05 for the six correlations. 
Only one is statistically significant. The medi- 
an r for the relationship between reality and 
adjustment is .25, significant at the 5% level. 
Among these six correlations, four are statisti- 
cally-significant. The median of the six r’s be- 
tween empathy and adjustment is .32, signifi- 
cant at tne 19% level. Five of these six r’s are 
statistically significant. 


Thus, for both intra- and intertrait rela- 
tionships, there apnears a hierarchy of order of 
correlation with adjustment.as follows: pro- 


58 


jection lowest, reality next, and empathy 
highest. From the standpoint only of signifi- 
cant r’s with adjustment, Projection has two, 
reality five, and empathy eight, according to 
Table 3. The second hypothesis, then, appears 
to be supported. 


Discussion 


Our hypotheses are generally upheld by the 
data, the method used in the present study 
giving valid results supporting current per- 
sonality theory. Certain methodological ob- 
jections may be raised, especially that of a lack 
of knowledge about the reliability coefficient 
of the judgments of others (i.e., when the test 
was taken the second time), the fact that ad- 
justment scores were changed in some un- 
known quantity by the elimination of the 
“? alternative, the comparatively low N 
which made a “51% criterion” only 38 cases, 
and the assumption that self-reports were 
valid measures of adjustment. The latter criti- 
cism has been particularly mentioned by Ellis 
[9]. However, despite these objections, it is 
the writers’ belief that this operational ap- 
Proach to the investigation of Personality dy- 
namics can be quite fruitful. It is certainly no 
accident that despite some of the crudities of 


tion, and the trend 
3, whether intra- 
nature hypothesized 
search might well e 
adjustment, Projection, 
to test whether our oper: 
any validity. 


empathy, and reality, 
ational definitions have 


Summary 


An attempt was made, using operational 


definitions of ternis, to verify two hypotheses, 
The first was that Projection would be nega- 
tively related to both reality and empathy, but 
that the latter two variables would be posi- 
tively-related to each other. The second was 
that reality and empathy would ferrelate more 
closely with adjustment than would Projrction. 
Both these hypotheses were generally verified, 
using a personality questionnaire, the GAM- 
IN, given under conditions wherein the sub- 
ject took *t for himself first, then made judg- 
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ments about others. Corsistent intra- and in- 
tertrait correlations in the direction predicted 
supported the first hypothesis. The second was 
supported by correlations giving a hierarchy of 
relation to adjustment from greatest to least 
of empathy, reality, and projection. 
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References 


1. Alexander; F. Fundamentals of psychoanalysis. 
New York: Norton, 1948. 

2. Allport, G. W. Personality, a psychological 
interpretation. New York: Holt, 1938 : 

3. Bellak, L. The concept of projection, an experi- 
mental investigation and study of the concept: 
Psychiatry, 1944, 7, 353-370. 

4. Cottrell, L. S., & Dymond, Rosalind F. ‚The 
empathic responses. Psychiatry, 1949, 12, ‘355- 
359. 

5. DeCillis, Olga E., & Orbison, W. D. A com- 
parison of the Terman-Miles M-F Test and the 
Mf scale of the MMPI. J. appl. Psychol., 1950, 
34, 338-342, 

6. Dymond, Rosalind F. The relati: 
and empathy. J. 
228-233. = 

7. Dymond, Rosalind F, A scale for the measure- 
ment of empathic ability. J, consult, Psychol, 
1949, 13, 127-133. 

8. Dymond, Rosalind F, Personality and em- 
pathy. J. consult. Psychol., 1950, 14, 343-350. 

9. Ellis, A. The validity of personality question- 
naires. Psychol. Bull., 1946, 43, 385-440. 


on of insight 
consult. Psychol, 1948, 12, 


10. Grossman, D, The construction and validation 
of two insight inventories. J, consult, Psychol., 
1951, 15, 109-114, 

11. Guilford, J. PA; 


» ~ Martin, H. G. The Guil- 
ford-Martin inventory of factors GAMIN. 


Beverly Hills, Calif.: Sheridan Supply ‘Co 
1943. 


12. Healy, W., Bronner, 
A. M. The structure 
choanalysis. New York: Knopf, 1945, 

13. Norman, R. D, The interrelationships among 
acceptance-rejection, self-other identity, in- 
sight into self, and realistic perception of 
others. J. soc. Psychol., 1953, 37, 205-235, 

14. Remmers, H. H. quantitative index of so- 
cial-psychological empathy. Amer. J. Ortho- 
psychiat., 1950, 20, 161-165. 

15. Sears, R. R, Experimenta 

I. Attribution of traits, 

7, 151-163. 

Steinmetz, H. C, Directive 

measuring psychological underst: 

Psychol., 1945, 1, 331-33% 


Augusta F., & Bowers, 
and meaning of psy- 


l studies of projection: 
J. soc. Psychol., 1936, 
16. psychotherapy: 
anding. J. clin- 


>. = 


Journal of Consulting Psy y 
g Psycholog: 
Se Vol. 18, No. 1, 1954 á 


oo 


f 


Moral Indignation: A Correlate of Denied Dislike 
of Parents’ Traits 


i Sidney M. Jourard 


o Emory University 


The hypothesis under consideration in the 
present study is stated as follows: Ss who 
„Will admit to a predominant degree only 
favorable attitudes toward many traits of their 
Parents will express a higher degree of moral 
indignation than Ss who will express some 
attitudes of dislike toward their parents’ traits. 
Phe indignation is defined as the expres- 
a of annoyance, anger, or hostility toward 

'Sgressors of social mores. 
sant rationale for the hypothesis may be 
hostilit as repression-displacement theory of 
towar ft According to this theory, hostility 
mens themselves is inevitably generated by 
dren their efforts to socialize their chil- 
allow a his hostility in the children may, be 
the ho denied expression. If it is denied, 
plate dren will learn to repress it, and dis- 
or E to hate objects provided by a culture 

Furt = guilt-free „expression of hostility. 

een where hostility toward Parents has 
Ñ harene ent the children willy tend to 
i Critical. the parents sga ap un- 
W Bruns almost magical termsj as Frenkel- 

Case a [1, pp. 340-346] found to be the 

intery} ighly authoritarian subjects whom she 

lewed. 


Mater: Procedure f f 
t mone Three questionnaires were devised 
i de a the relevant attitudes, viz: a moral 
e fea scale (MI), a scale to measure 
er tthe of each § toward 61 traits of his 
p an ideation Father-cathexis scale, Cr), and 
the moth al scale to measure feelings toward 
er (Mother-cathexis scale, Cyr). 


0 L} . + a 
. ral indignation scale.* Fifty stacements 


Th 

. The : i š 
With the a sstionnaire forms have been deposited 
merican Tocumentation Institute. Order 


were selected which seemed to describe “breach- 
es of common decency” and which would stim- 
ulate moral indignation in a person. Many of 
these were paraphrased from items used in the 
F scale [1] and from Cason’s study of annoy- 
ances [2], while others were devised by the 
writer.? The Ss were required to indicate on 
the following five-point scale the degree of 
annoyance provoked by each situation: 


. Not annoyed 

. Slight irritation 

. Annoying 

. More annoying 

. Makes me furious 

Sample items are as follows: A communist making 
a speech to you about his belicfs. A person who 
avoids the army draft because of “nervous” illness. 
The rapidity with which Hollywood stars change 
spous& 


Wrens 


Father-cathexis and Mother-cathexis scales? 
Sixty-one traits were listed, and S was re- 
quired to signify the nature of his feelings to- 
ward each of these traits, as he knew them in 
his father and mother. 


The scale was devised as follows: 
1. Have strong positive feelings: encircle a 1 
for those aspects of the person which you like very 
, much. 


2Many ideas for items were obtained by perusal 
of letters to the editor of the local newspaper where 
manners and morals are commented upon, often 
with moral indignation. Finally, one important 
source of ideas for items deserves mention — the 
topics about which the writer, his colleagues, and 
many „housewives gossip whe:. gathered fo1’’social 
purposes. 


Documcnt No. 4032 from ADI Auxiliary Publica- 
tions Project, Photoduplication Service, Library of 
Congress, Washington 25, D.C., remitting $1.25 for 
35 mm. microfilm or $1.25 for 6 x 8 in. photocopies. 
Make checks or money orders payable to: Chief, 
Photoduplication Service, Library of Congress. 
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2. Moderate positive feelings: encircle a 2 for 
those traits which you like in the person, but not as 
strongly as in category 1. 

3. Have no feelings one way or the other: en- 
circle a 3 for those aspects of the person about which 
you have no feeling. 

4. Have moderate negative feelings: encircle a 
4 for those aspects of the person which you dislike 
moderately, 

5. Have strong negative feelings: encircle a 5 for 


those aspects of the person which you strongly dis- 
like. 


Sample items from the questionnaires are: sense of 


humor, temper, general knowledge, ability to express 
sympathy. 


Subjects. One hundred and fifteen Ss served 
in the study. These included 69 male college 
undergraduates, 24 college females, 17 females 
from a YWCA social club, and 5 Air Force 
men tested by a student assisting the writer. 
The age range was from 18 to 42, with a mean 
of 23 and an SD of 4.23. 


Testing procedure. All the questionnaires 
were administered at one sitting—the MI first, 
and then the Cp and Cy s 


cales. Instructions 
, were as follows: 


On these scales, you are asked 
feelings. Please fill 
honesty as you can. 
asking you only to Pp 


to indicate your 
them out with as much self- 
To assist you in this, we are 


ut down your birth date, so you 
need not fear what anyone might think converning 
how you respond, Remember, Please, to examine 
your feelings, so that your answers reflect these as 
accurately as possible. 


Results 


Means, standard deviations, range of scores, 
and odd-even reliability coefficients for the 
three tests are shown in Table 1. 

All three tests appear to have high reliability 
and a broad range of scores, 

The general hypothesis may be restated as 
follows: there will be a negative correlation 
between MI scores and both Cr and Cy scores, 

The moral indignation scores were found to 
correlate —.39 with Father-cathexis, and =87 
with Mother-cathexis. Both r’s. hile low, are 


significant beyond the .001 leVel, and support 
the hypothesis. 


Discussion 


The p.esent data signify that persons who 


Table 1 


Means, Standard Deviations, Ranges, and 
Reliability Coefficients for the 
Three’ Questionnaires 


6 


Mean g Range 


Moral indignation 136.36 22.90 86-192 .90 
Mother-cathexis 137.48 29.50 80-209 .95 


Father-cathexis 136.38 28.08 67-206 95 


of 
* Correlations are between odd and even hal 
tests and are corrected by the Spearman-Brown form 


admit predominantly favorable attitudes to 
their parents tend to express a high degree © 
moral indignation, as defined and measure 
herein. Persons able to admit more criti 
feelings (higher Cp and Cy scores) towaf 
their parents tend to produce lower MI scores: 
It must be noted, however, that the corre 
lations, despite their high confidence level, are 
low; a very small amount of the variance in | 
MI scores is accounted for by variation 1n the l 
parent-cathexis scores. This should not be ; 
surprising since there might be many reasons 
for the expression of moral indignation besides 


the displacement of repressed resentment 9 
parents. 


Summary 


One hundred and fifteen persons were tested 
with scales designed <o ineasure moral indig | 
nation and attitudes toward parents, It w3 | 
hypothesized that °x.who admit little criticis™ 
and dislike” `of their parents would show 
higher indignation scores than Ss who do 
admit some dislike of their Parents’ traits, Low 


but highly significant correlations between 


scores and Cy and Cp scores supported. this 
hypothesis, 
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The Comparability of Measures of Profile 


Similarity: An 


Empirical Study 


James N. Mosel 


Phe George Washington University 


and June 


Pies years there has been an increased 
aR din the use of psychometric profiles in 
sonnel lagnosis, vocational guidance, per- 
This _evaluation, and even social psychology. 
ben, end emphasis has resulted largely 
individ e renligation that interpretation of an 
ien S set of scores, for diagnosis or pre- 
Pattern, must frequently be based upon the 
Upon, co or configuration of scores, rather than 
a4 Fr ging of one,test at a time or upon 
mean oe sum of scores. Computation of 
criterion = differences between nosological or 
| combina oe or the derivation of linear 
jon Cant tons of test scores to predict a criter- 
etn the multiple-regression equation and 
Hanconfe function), exemplify the latter, 
many aal approach. It has been felt by 
tional heed clinicians, that these conven- 
ail to t k niques are inadequate because they 
= Nostic k Canto account She act tl t the diag- 
a tous r predictive meaning (ie weight) of 
according one test is not conséant, but varies 
tests, g to the scores obtajáed on the other 
Pretation Se the argument goes, inter- 
is math must consider patterns of scores. This 
Mterpr matically tantamount to saying that 
| Se €tation involves a nonlinear combination 
| Signed) Ponlinear in that the weights as- 
| as a fu to each test are not constant but vary 
the iter ee of score on the test itself and on 
tionships tests. It is this set of intertest rela- 
tion that f defined by a nonlinear combina: 
Con: pies by such terms as “pattern, 
Ston of th ion,” “profile effect,” etc. Discus- 
Vs, ineg € problems arid concepts of configural 
Will be ; treatments of multiple measuren.ents 
ound in Horst [6] and Mosier [9]. 


j 


B. Roberts 


Pennsylvania State College 


The great interest in patterns has quite naturally 
led to the problem of matching profiles—measur- 
ing the degree of similarity in the pattern of two 
profiles. The usual situation in clinical practice in 
which this need arises is where a standard or 
reference profile has been established? and it is de- 
sired to match a given “unknown” or referred pro- 
file against it. The assumption underlying this is 
that the closeness of the match measures the extent 
to which the unknown profile will display certain 
criterion or nosological characteristics associated 
with the standard profile. 


The need for profile matching also arises in 
the research situation when it is desired to 
learn whether the profiles of one diagnostic 
category are more similar to each other than 
they dre to the profiles of some other diagnostic 
category. The principle here is that if the 
within-groups similarity is not greater than be- 
tween-groups similarity, the groups cannot be 
distinguished by profile patterns. This is illus- 
trated in a study by Kogan [7], who attempted 
to discriminate between schizophrenic and 
neurotic patients by means of Wechsler sub- 
test patterns. In a similar vein, Q technique 
attempts to determine whether the agreements 
among the profiles of persons are such that 
when factor analyzed, a typology can be estab- 
lished. Investigations of this type, incidentally, 
provide one approach to the clinical problem 


*The problem of identifing and specifying 
standard profiles is beyond the purview of this 
paper, but it is q. ite apparent that systematic meth- 
ods are yet to be developed. It should be noted 
that the conventional procedure of computing the 
mean scores of a given criterion group and then 
using the resulting profile of averages as the stand- 
ard completely ignores the possibility that the num- 
ber of characteristic profiles may be givater than 
one. ` 
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of establishing the standard or reference pro- 
file mentioned above, Before a standard pro- 
file can be established, it must first be shown 
that a basic profile exists which is typical of 
the criterion group and which differentiates 
this group from others, 

There are two aspects of profiles on which 
matching may occur: the Shape or configura- 
tion of scores and the general elevation (also 
called intensity or level) of scores as indicated 
by some measure of central tendency. Thus we 
may speak of matching for absolute agree; 
in which we consider similarity of both 
and elevation, or for relative agreeme 
which we consider only similarity of sh 


ment, 
shape 
nt, in 
ape. 


shape alone, 


what em- 


several types of i 
perhaps more cle 


research designe 
vides the greates 


One interesting variation 
Proach is that of Barnette 
separately differences j 


of the empirical 


[1], 


profile shapes but different 
group having a more elevate 
mild. 

There are, of course, certain situations where no 
outside criterion is available or even meaningful, 
such as in Osgood’s nse of profiles to display con- 
notative meaning [10]. In such cases an eatirely 
rational decision is not only neca.sary but proper, 


Indices of Profile Similarity 


In an attempt to overcome the obvious dis- 
advantages of matching profiles by visual 
judgment, a number of Statistical indices of 
profile similarity have been proposed. These 


the severe 


d profile than did the 
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are described below, but because the presen 
study is concerned with the empirical agree- 
ment among these, no attempt will be made 
to elaborate upon or evaluate their statistical 
roperties.” 
á Correlation coefficient. Perhaps the most ob- 
vious and generally employed statistic is the 
product-moment or rank-difference correlation 
coefficient. The correlation technique yields s 
nonarbitrary ‘measure which reflects similarity 
of shape but disregards elevation. This inor 
ranges from 1.00 for high similarity, throug? 
zero for no similarity, to — 1.00 for high in 
verse similarity (i.e, when the two profiles ag 
mirror images of one another). The correla- 
tion coefficient has a disadvantage in that pro 
files of rather dissimilar shape can have egu 
correlation with the standard profile. Also, the 
value of 1.00 does not necessarily indicate 
perfect similarity ; two profiles can be quite dis- 
similar in shape and still correlate perfectly. 
Meehl’s difference index. This measure [8 


reflects shape but neglects elevation. The com 
putational procedure is as follows: 


1. Obtain for each Profile the deviations (keeP” 
ing algebraic sign) of the scores of each test from 
the second highest test in the profile. These values | 
may be symbolized as d. 

2. Obtain the differences between the correspond- 
ing deviations in the two profiles. These values 
may be symbolized as 8, 


3. Square the 8's after first rounding to the 
nearest tenth. 


| 
’ - i 
4. Sum, the squared ô’s of the N tests and extract 
the square root. œ 
In formulò- form; ~- 
Mi 
v Sal = 82, 
where ôi =d; — diy; and dj = Xi — S; and 
di = Xu — Sı, in which Xij and Xj, are cor- 


responding scores of profiles 7 
N tests), and S; and $, 


Scores in profiles j and / re 


and / on test į (of | 
are the second highest 
spectively, 


Meehl states that his index tells how fat 


j 

*For a general discussion of various indices, s¢° / 
Cattell [2]. Dw Mas [3], und Grice ang ton [5 
Intraclass correlation, however, considers both 
shape and elevation differences [16]. This is bê 
cause the deviations are taken from the grand men! 
» On the other hane 
ricted negative range 
rounded values cof 


*Meehl 


[8] reports that the 
relate 


-95 with the unrounded, 


| 
] 
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apart two profiles arë in the hyperspace of N 
dimensions in which each profile is projected 
as a point. The smaller the value the closer the 
match, although the index is an arbitrary one, 
aving no absolute meaning. Since its value 

depends on the number of tests, it is comparable 
only for matchings in which all pairs of pro- 
files have the same number of tests. Meehl re- 
pone ‘that the index correlates .68, .65, and 
koea subjective estimates of similarity made 
Sually by three judges. This index is very new 
and Meehl admits that it is frankly experi- 
co and that its statistical properties re- 

un to be determined. 

escripicient Osgood and Suci [11] have 

shape = m index designed to reflect both 
apparently elevation, Although these authors 
same hetl consider their proposal as new, the 
agebeer lod was suggested some time ago by 

EIS), wh [13] and more recently by Toops 
Whe ms o olle it the “precise profile method.’ 
Principle th. icient is based on the geometric 
Onal dj that in a space of N mutually ortho- 

Points į mensions, the distance between two 
'S equal to the square root of the sum 

inates Pei differences between the coor- 

Profiles m ` b Points on cach dimension. Since 
Where p e considered as points in N space 

Ìstanc, equals the number of tests), the 

i © between them serves as a measure of 


Similarity Tis m BSE? 
mul arity. This distance is D, which in for- 
a form js: 


D 


a 


D = 


Whèr 
tdo Kl 
are the i = Xi; — Xip in whyin X;; and Xi 
test j of responding scores of frofiles j and / on 
Simple; tests. The computdtional procedure is 
l. Obtaj 
dta . 
Scores as the difference between corresponding 
each test for the two profiles. 


-S 
ua 
Aware and sum these differences. 


has the square root. . 
Ike z 3 e 
arbitra Mechl’s index, the D coefficient is an 


number” Farag! whose value depends on the 
© noted tests in the profile. It should also 
When th that the above formula applies only 
Dy 1, tests are uncorrelated. 
Mas (4) h Coefficient of profile similarity. Du 
fi imi as introduced the coefficient of pro- 
in term, anity, ry, which describes similarity 
* of the agreement in slope between 
€ > 
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corresponding segments of the two profiles be- 
ing matched. By “segment” is meant the line 
drawn from one score point on the psycho- 
graph to another adjacent point. The slope is 
positive when the left score point of a segment 
is closer to the bottom horizontal of the graph 
than is the right score point. Zero slope occurs 
when the segment is parallel to the bottom 
horizontal. 


In formula form: 


fp = 2 (S/T — .56), 


where S is the sum of the corresponding profile seg- 
ments which exhibit slope of the same sign, and T 
is the total number of segments in which no zero 
slope occurs. The standard error of rp, is given by 
Du Mas as 

Orp VIVE. 


thus enabling a test of the null hypothesis. Du Mas 
[4] states that the assumptions underiying tae co- 
eficient are that the test score distributions are 
symmetric and identical, the regression of one test 
on another adjacent test is linear, and the sequence 
of the tests remains fixed. 

Obviously, rps considers only profile shape 
and, in addition, loses precision because it is 
based only upon the sign of the slope, not the 
magnitude. Consequently, it is quite possible, 
as Du Mas himself points out, to obtain a very 
high index of similarity’;when the two pro- 
files Wre quite dissimilar in both shape and 
elevation. While rps can range from —1.00 to 
1.00, it cannot, however, always assume a zero 
value. Moreover, it yields a discrete rather 
than continuous distribution of values. The 
number of possible values it can assume can 
never be greater than N + 1 (where N is the 
number of tests in the profile). For a four-test 
profile rps can assume only five values: 1.00, 
0.50, 0.00, — 0.50, and — 1.00. Also, the fact 
that the index is an arbitrary function of the 
order in which the tests are arranged may con- 
stitute a criticism. This feature is not shared 
by the other indices described here. The index 
has the advantage, however, of being rapid to 
compute, especially in view of the tabie Du 
Mas gives fc^ cases where T < 30. 

Cat‘el!’s coefficient of pattern similarity. 
This coefficient, rp, is one of three indices de- 
veloped by Cattell [2] to measure different as- 
pects of profile similarity, the other two being 
his coefficient of pattern shape, rs, ard his co- 
efficient of pattern-effect, 7’. He concluded 
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that the most generally applicable is Tp since 


this index is designed to reveal both profile 
shape and elevation. 


The present paper will therefore be confined to 
Tp which is defined by the formula 


2k — Ed? 
2k + Zd? 


where k is the median for chi square (i.e., the value 
of chi square at p = .50) with degrees of freedom 
equal to N — 1, where N is the number of tests in 
the profile; and d is the difference between corre- 
sponding scores on the two profiles at each test, ex- 
pressed in standard score form with respect to the 
distribution within that test. 


Tp = 


Cattell states that for practical purposes the 
index can be considered as approximately simi- 
lar to an ordinary correlation coefficient. It 
ranges from 1.00, meaning perfect similarity, 
through zero, meaning complete lack of rela- 
tion, to —1.00, meaning complete inverse rela- 
tionship. The assumptions are that the tests 
are independent and that the distribution of 
each test is normal. 


Purpose of the Present Investigation 

In view of the above multiplicity of meas- 
ures, a crucial question relates to the amount of 
agreement these measures would display in 
rank ordering a set of profiles in similarity to 
a standard profile. The purpose of the present 
study was to determine empirically the com- 
parability of these measures as revealed by their 
intercorrelations. Inasmuch as these measures 
were originally devised to replace the presum- 
ably less reliable method of subjective match- 
ing, an additional purpose was to compare the 
statistical indices with the results from visual 
judgment. The question also arises as to 
whether the agreement among indices varies 
according to the standards used. Correlations 
were therefore computed separately for 
matchings in which differing profiles were 
used as standards. 


Procedure 


Actual profiles were used... consisting of 
scores on the first five subscales of he- Kuder 
Preference Record as obtained from a group of 
supervisors in a government agency. Four pro- 
files were selected as standards because of their 
extreme’ visual dissimilarity. A group of 30 
other profiles sei ved as “referred” profiles. Us- 


James N. Mosel and June B. Robents 


ont PE E 
ing the five indices desc.ibed above, aie 
of similarity to each standard were comput! 
for each referred profile. 


Subjective Matching 

In measuring similarity by visual inden 
an effort was made to secure reliable ju a 
ments. Apparently no studies have been ne, 
of the reliability of judges or of methods ly 
rating the similarity of profiles; consequent 
several preliminary studies were made be 4 
two judges and three rating methods. Ju a 
A was a psychologist; judge B, an engin 
For whatever significance it may have, bo 7 
judges were above the 85th percentile on t% 
Minnesota Paper Formboard. 4 

Method of single stimuli. The judges ari 
each profile against each standard on the fol 
lowing six-point scale: 1: “almost identică ts 
2: “very similar,” 3: “fairly similar, ne 
“somewhat similar,” 5: “no resemblance, 
“completely opposite.” To permit the judg? 
to establish a stable subjective scale of ju4® 
ment, all profiles were matched against o 
standard before rating against the next sta” 
ard was begun. Each judge repeated his ratt” 
one week later. 

Rank-order method. Next, each profile wa 
ranked in order of similarity to each standart 
The judges first rank ordered the profiles Pr | 
viously assigned to each rating-scale interv” 
When profiles had thus been ranked withi® 
each group, they could readily be placed in 4% 


over-all rank ortz of similarity to the stand” 
ard. w 


Method op stiads. As a further check on th? 
reliability of tht, above rank orders, judge 
assigned a second set of rank-order values using 
the method of triads [12]. In this method thé 
judge compares two referred profiles with thé 
standard and decides which of the two most rë 
sembles the standard. As in the method of 
paired comparisons, all possible pairs of 1% 
ferred profiles are thus compared with t 
standard. The total number of times each p10” 


file is judged most similar can then be used © 
yield rauk orders, 


‘é Results c 
Judgmental matching. Table 1 shows th 

rate-rerate reliabilities of the two judges 11%, 
the method of single stimuli (correlations © 
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pressed as Pearson r)>and from the method of 
aa order ‘(correlations expressed as rho). 
ceed 2 shows the interjudge agreement for 

e two methods, . basing the intercorrelations 


on the mean of éach judge's first and second 
Tatings, 


7 Table 1 
wee Reliabilities of Two Judges in 
paling 30 Profiles against Four Standard 
rofiles by the Method of Single Stimuli 
and the Method of Rank Order 


5 Judge A Judge B 
t 
andard Single Rank Single Rank 
stimuli® order stimuli order 
: J5 87 85 87 
A 91 95 88 90 
4 92 95 .70 78 
83 .76 46 25 


. 
kien correlations for the method of single stimuli are 
n rho, F earson r; those for the method of rank order 


Ti 
Intere , Table 2 
orrelation between Two Judges in Matching 


p erofiles against Four Standards by the 
ethod of Single StimGli and the Method 


of Rank Order 
St 
andard Single stimuli (r) Rank order (P) 
= .28 33 
: 80 85 
k .50 67 
71 58 


— 
Pha bi noted that the rank-ordes method 
Method om higher reliaþ’™ äes thea does the 
t x ‘Single stimuli. As migh?0¢ expected, 
OWer a idge reliabilities afe consistently 
an the rate-rerate re}-abilities. 
faj 
S self consistent but differ somewhat in 
Very nitions of “similarity.” Judge A has 
Supe > ĉCCeptable reliability, being somewhat 


‘De 4 wha 
urther to judge B. Judge A’s reliability is 
Mean evidenced by a rho of .80 between the 


aa a his first and second values from the 
This copy method and the method of triads. 
aerate "e egion is almost as great as A’s rate- 
The onae y by the rank-order method. 
HY the Re es is that the ratings of judge A 
hese W -order metliod are the most reliable. 
With en therefo e retained for comparison 
Various statistical indices of profile 

£ - 


hi é j i 
€se results indicate that both judges are _ 


similarity. 

Index agreement. Table 3 shows the ma- 
trix of intercorrelations (rank difference) 
among the five statistical indices of profile 
similarity and the subjective judgments of 
judge A. The correlations have been deter- 
mined separately for each standard profile. 


Table 3 
Intercorrelations among Five Statistical Measures 
and Visual Judgments of Profile Similarity; 30 
Profiles Matched against Four Standard 
Profiles 


(Correlations expressed as rho) 


Measure Meehl Osgood Du Mas Cattell Pearson 
Standard 1 7 

Osgood 73 

Du Mas 005 30 

Cattell 81 51 «04 

Pearson 70 28 -17 60 

Judge A -65 Al 50 78 A9 
Standard 2 

Osgood 81 

Du Mas 82 378 

Cattell 65 64 73 

Pearson 80 71 14 54 

Judge A 80 IT A SON 6842 IS 
Standard 3 

Osgood 60 

Du s A9 46 

Dua 32 31 48 

Pearson 14 42 .20 -.006 

Judge A .29 +28 57 .55 -.002 
Standard 4 

Osgood 65 

Du Mas 25 -11 

Cattell 59 AS 12 

Pearson 54 40 23 50 

Judge A 38 06. 40 Al ayy, 


It is obvious that the type of standard em- 
ployed makes a sizable differeace in the amount 
of agreement among the measures. For in- 
stance, the Du Mas and Meehl indices corre- 
late .005 when the profiles are matched against 
Standard 1, but .82 when Standard 2 is used. 
This Means, of course, that the extent to which 
these measures are tapping a common factor of 
“similarity” varies according to the profile 
adopted as the standard. The comparability of 
the measures cannot, therefore, be stated in 
absolute terms; it depends on the standard 
against which the profiles are matched. 


66 


Inspection of Table 3 reveals that the two 
measures which disagree most with the other 
measures are the Du Mas coefficient’ and 
Pearson r, especially the latter. Cattell’s co- 
efficient agrees most closely with subjective 
judgments of similarity, while the indices of 
Du Mas, Meehl, Osgood, and Pearson follow 
in that order. The indices of Meehl and Os- 
good intercorrelate more highly on the whole 
than do any other pairs of measures. This is 
somewhat surprising in view of the fact that 
the former reflects only profile shape, while 
the latter reflects both shape and elevation. 


Summary 


The agreement among five statistical indices 
of profile similarity and visual judgments was 
studied through intercorrelation. A group of 
30 profiles from the Kuder Preference Record 
was matched against four different standard 
profiles, and the resemblance was measured by 
Cattell’s coefficient of pattern similarity, Du 
Mas’ coefficient of ‘profile similarity, Osgood 
and Suci’s D coefficient, Meehl’s index, and 


5 Pearson r. Visual judgments of profile similar- 


ity by two judges using two methods (single 
stimuli and rank order) showed acceptable 
rate-rerate reliabilities; the interjudge relia- 
bilities were somewhat lower. The scale values 
from the most reliable judge using th® most 
reliable method (rank order) were adopted 
for comparison with the results from the five 
statistical indices. 

Results showed a wide degree of disagree- 
ment among the measures as to the rank or- 
der in which they arranged a set of profiles 
with respect .to similarity to the standard pro- 
file, the rank-difference intercorrelations rang- 
ing from —.006 to .90. Also, the amount of 
agreement between any two measures of pro- 
file similarity varied considerably according to 
the particular profile employed as the stand- 


ard, thus indicating that the comparability of- 


the measures cannot be stated 
terme but is contingent upon the sta 
Cattell’s coefficient showed theel 


in absolute 
ndard used. 
Osest agree- 

5The correlation of Du Mas’ Tam with the other 
indices is undoubtedly reduced because of the re- 
stricted range of values which this index can as- 
sume. No correction for widespread classes was 
made, however, because it was desired to ascertain 
the interrelationships in terms of the categories 
given. 5 
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ment with visual judgments, while the indices 
of Du Mas, Meehl, Osgood and Suci, and 
Pearson followed in that order. The greatest 
agreement among the statistical indices was 
that between the coefficients ‘of Meehl and Os- 
good. 
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Children’s Responses 
Figures in Th 


to Animal and Human 
ematic Pictures’ 


Mary Ann Smith Armstrong 


Institute of Child Welfare, University of Minnesota? 
9 


T he Children’s Apperception Test (CAT) 
1] is a Projective test for children primarily 
Gos the ages of three to ten years. The 
eg based on the theory that children can 
with ri more readily with animal figures than 
n uman figures. 
eee Problem of this study was to determine 
Tater: Picture series elicits more thematic 
rial. The hypotheses of the writer are as 
allows; 
walt Pictures which contain human figures 
evoke longer fantasy productions. 
iii verbalization which is nonde- 
in content will occur in protocols based 


o : 

n human figures. 

have oe, verbs, and ego-related words will 
Igher fre ies i i ing hu: 

man fi quencies in stories having 


tures as their main characters. 

sponses to pictures depicting human 

nships will involve more “blocking,” 

» IN turn, will produce a longer reaction 
= 


relatio 
Vhic 
time, 
st) 


T Method, r4 
the he subjects were 66¢hildren %o attended 
sven second, and pce ied in the 
ee of Minnesota elefentary school. 
€ach ample included 10 boys‘and 10 girls from 
fea” The mean age of the first grade 
Secon 7 V@S 6-7, with a range-fram 6-2 to 7-3. 
to gs Stade subjects ranged in age from 7-3 
thirg °, With a mean age of 7-6. Children in 
Nge vidio had a mean age of 8-6, with a 
rade am 8-1 to 8-11. The mean IQ of first 
the ie measured by the 1937 Revision 
anford-Binet was 120, with a range 


Ta 


he wp; 
d Date ats wishes to express her appreciation to 
arris for his helpful suggestions in 
of this mdnuscript. 
State De-artment of Education,’ St. 
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from 76 to 156. Children in the second grade 
had a mean IQ of 131, with a range from 108 
to 17+. Third grade subjects ranged from 97 
to 172, with a mean IQ of 123. The subjects 
were predominately of upper socioeconomic 
status. 

Bellak’s CAT pictures were ranked by 10 
judges on the basis of their supposed stimulus 
value in evoking verbalizations from children. 
Graduate students and faculty served as raters. 
Five pictures from the original CAT were 
selected for use in this study on the basis of the 
mean ratings obtained. The experimental pic- 
tures (Series B) depicted a feeding situation 
(Card 1), attitudes toward parents (Card 
2), sibling rivalry (Card 4), acceptance by 
adult figures (Card 8), and conceptions of 
punishment (Card 10). A duplicate set of pic- 
tures corresponding to the CAT in style and 
composition was drawn by Heidi Schwa- 
bacher, graduate art student at the University 
of Minnesota. The duplicate pictures (Series 
A) contained human figures in place of animal 
figures; in all other respects the two sets of 
pictures were equivalent. Both picture series 
were ambiguous with respect to sex. 

In order to counteract the facilitating effects 
of the initial test on the final test with respect 
to increased productivity, two groups of 30 
children were chosen from the original sample 
by means of random numbers. Each group con- 
s‘sted of an equal number of boys and girls 
from each grade, thereby equalizing the factor 
of sex differences within th group. The two 
sets of picturc. were administered in random 
order, usit.g a test-retest method: Group A 
was given Series A, followed by Series B; 
Group B received Series B, followed by Series 
A. Retests were administered following a time 
interval of two weeks. y 
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Instructions to the subjects were held con- 
stant for both sets of pictures. The experi- 
menter presented each picture to the child with 
the request, “Tell me a story about this pic- 
ture.” To clarify a point in the child’s story 
the experimenter said, “Tell me more,” “What 
do you mean?” or “Explain it to me.” At ap- 
propriate places in the story the experimenter 
asked, “What happened before?” and “What 
will happen later?” The experimenter was 
limited to three questions in the administration 
of a single picture. 


Measurement of the subject’s reaction time was 
held constant for each picture. The child’s response 
was timed with a stop watch from the presentation 
of the picture to the completion of the story. Total 


reaction time was recorded in seconds for each pro- 
tocol. 


Analysis of the fantasy data according to length 
of the response was done using the scoring system 
developed by McCarthy [2] in an earlier language 
study. Contractions of the subject and predicate 
counted as two words. Hyphenated words and com- 
pound nouns referring to single objects scored as 
one word. Contractions of the negative and the verb 
counted as a single word. Each part of the verb 
form was scored as one word. 


Indices of the nouns, verbs, and ego-related words 
were computed on the basis of their frequency in 
the individual protocol. A word counted as a noun 
or verb depending on its function in the sentence. 
Compound nouns and verb combinations våre con- 
sidered single words. The phrases, “it looks like,” 

it seems as though,” “jt seems like,” and the per- 
sonal pronouns, I, my, me, and mine were scored in 
the Ego-Related Word Index. The response “I don't 


know” was not classified as an ego-related word. 
Analysis of the stories in terms of nonde- 
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scriptive verbalization* was done using the 
transcendence categories outlined by Weiss- 
kopf [3]. The Transcendence Index of a pic- 
ture was obtained by counting the number of 
comments about the picture which exceeded 
pure description. The mean number of nonde- 
scriptive remarks per subject constituted the 
index of the picture. 


Two additional categories were used in 
computing a Transcendence Index, a sex- 
reference category and a naming category. The 
category of sex reference refers to the char- 
acterization of a figure in relation to its 
sex by the use of a singular or plural word. 
The naming category is the characterization of 
a figure by the use of proper nouns. The terms 
“baby” and “child” were not scored in any 
category. 

The total number of seconds required by 
the subject to project himself into a particular 


picture was considered an index of reaction 
time. 


Results 


Means and standard deviations were ob- 
tained for length scores by sex and grade 
(Table 1). With grade progression, children 
tend to tell longer stories. Girls give slightly 
but consistently longer protocols than boys: 
There is no consistent tendency for anima 
pictures to evoke longer protocols than human 
pictures, F 

An analysis of nouns and verbs used, by the 
Procediie. emplayed in Table 1, showed slight 
but are grade wd sex differences, but no 


x 
Table 1 À 
Length of Response Means and Standard Deviatio yy Grade 
and Sex for Humap and Animal Pictures } 
Grade _ Picture Boys Girls = Total 
SD M SD M SD 
Human 61.48 29.25 64.54 
die f 36.45 63.01 33.08 
A Animal 75.22 . 36.45 56.54 , 36.49 65.88 37.65 
Human 5.64 33.13 68.66 52.13 67.65 43.69 
Second 7 2 we 
Animal 64.38 33.02 70.80 35.77 67.59 34.57 
Human 62.30 44.33 86.02 46.09 74.16 46.75 
Third. ‘ f ` 
Animal z $ 
nima : 65.12 38.58 88.28 58.17 50.70 
¢ 
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Picture differences; thé data are omitted in the 
interest of brevity. i 

Table 2 presents the means and standard 
deviations for ego-related word scores by grade 
and sex. A developmental trend may be dis- 
Closed in the grade means. The use of first 
Person pronouns shows a slight but consistent 
decline with grade progression. Again, there 


are no differences attributable to picture 
source, 


a Table 2 
Bo-Related Word Means and Standard Deviations 
by Grade and Sex for Human and 
Animal Pictures 


Grade Picture Boys Girls Total 
SD M SD M SD 
Pir, TOMA 1.92 141 2.64 1.73 2.28 1.73 
Animal 2.86 2.00 2.04 141 245 1.73 
Human 1 
Second 24 1.00 186 141 155 141 
Animal 1.64 1.73 1.62 1.73 1.63 1.73 
Him 
Third an 1.62 141 446 141) 1.54 14 
Animal 1.50 1.73 1.54 2.23 1.52 2.00 
Tire transcendence scores and standard de- 
i ons by sex and grade are found in Table 
differ © means for the three grades suggest a 


ence between the, two series of pictures. 


ildren aos € 
tive en give a greater number of nondescrip- 
human 


figures ents in their resnenses t% 
„S than to animal, Sires. Gis tend to 
P 
Tr Table 3 £ 
anscende d a 
Tade nce Means and Staraard Deviations by 
and Sex for Human and Animal Pictures 
G 
= Picture Boys i onas Total 
SD M SD M SD 
Fine man 7.98 3,74 9.00 5.91 249 489 
Animal 7.42 3.74 6.86 4.79. 7.14 424 
Secong Man 9.30 3.74 9.50 6.16 9.40 5.09 
Animal 6.86 2ga 7.58 4.35 7.22 3.60 
Thig ™™an 8.32 3.97” 10.20 5.09 9.26 4.58 


Ani 
“mal 712 4,24 9.50° 6.24 8.31 5.47 
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make more statements which are subjective and 
personalized than boys. 

Means and standard deviations were com- 
puted for reaction time scores by grade and 
sex. The data, omitted in the interest of brev- 
ity, show that girls have a consistently longer 
reaction time than boys in all grades. 

Analysis of variance procedures were ap- 
plied to the various scores reported in Tables 
1 to 3 and in the text above. Table 4 sum- 
marizes the results of these various analyses. 
The sex differences conform to the well-known 
superiority of girls in various language meas- 
ures. The grade differences, too, are not sur- 
prising. The results with respect to human and 
animal pictures are significant. Mean lengths 
of protocols and mean reaction times for the 
two sets do not differ. Nor do the sets differ 
in the number of naming responses, action 
words, or ego-related words. ‘There is a signifi- 
cant difference between the animal and human 
figures with respect to Weisskopf’s transcend- 
ence scores. Contrary to the assumption of the 
Children’s Apperception Test, the difference 
favors the human pictures, which evoke signi- 
ficantly more subjective, personalized, inter- 
pretive responses, other than pure description. 
It is to be recalled that these conclusions are 
based on normal elementary school children, 
somewnat superior in intelligence. On every 
measure the variance among the means of 
children was significantly greater than the 
average variance within a child’s responses to 
the several pictures. 


Table 4 


Results of Analyses of Variance Applied to 
Different Scores Derived from Thematic 
Picture Protocols 
” [Entries indicate the level of significance sat- 
isfied by the F ratio of the between-means vari- 
ance tested against the remainder variance (the 

within-children variance) ] 


gö ge g6 Pa) 

Se Say Saf Sap 

Comparison È A g ld $9 Eas È Efe] 

g meg G65 GER Ses 
Length or protocol 05 01 01 
Number of nouns 01 01 01 
Number of verbs 05 01 
Number of ego words 01 01 
Transcendence scores .01 61 4:02 
Reaction time 05 -01 


70 Mary Ann Smith Armstrong 


Discussion 


The original hypothesis that human pictures 
will evoke no more thematic material than 
animal pictures is refuted. The hypothesis 
that human pictures will evoke more nouns, 
verbs, and ego-related words fails to be re- 
futed, as does the hypothesis that human pic- 
tures will induce more “blocking” as measured 
by reaction time to the picture. 


Summary 


Two duplicate series of pictures, one using 
animal and the other using human figures, 
were given to 60 children according to the fol- 
lowing plan. Two groups of 30 children were 
chosen from the original sample by means of 
random numbers. Each group consisted of an 
equal number of boys and girls. Group A was 
tested with Picture Series A, followed by Pic- 
ture Series B; Group B received Picture 
Series B, followed by Picture Series A. The 
picture series were separated by a time inter- 
val of two weeks. The arrangement of the pic- 
tures in a series for each subject was random- 
ized by recourse to a table of random numbers. 

1. With grade Progression, children produce 


ED 


longer protocols. As chridren advance in grade 
level, they employ more nouns and fewer first 
person pronouns in their protocols. 

2. Girls use a greater number of nouns and 
verbs in their protocols than boys. Girls em- 
ploy more words and more nondescriptive 
comments in their protocols than boys. Girls 
have a slightly longer reaction time than boys. 

3. Human figures evoke more verbalization 
which goes beyond pure description than do 
animal figures. 

4. All scores used in this study are subject . 
to greater variation among children than aver- 
age variation “within children” (i.e, between 
all pictures for one child). 


Received May 25, 1953. 


References 


Bellak, L. Children’s Apperception Test, New 
York (P.O. Box 42, Gracie Station) : C.P.S. Cos 
1949, 

McCarthy, Dorothea A, The language develop” 
ment of the preschool child. Minneapolis: Uni- 
ver. of Minnesota Press, 1930, 

3. Weisskopf, Edith 7A, A transcendence index as 


a proposed measure in the TAT. J. Psychol 
1950, 29, 379-390, 


-$ Journal of Consulti 
Sp ‘onsulting Psychology 


N 


| 


| 
| 
| 


Vol. 18, 


3. 


No. 1, 1954 


Delinquent vs. Nondelinquent Performance on the 
Porteus Qualitative Maze Test * 


Richard F. Docter and C. L. Winder 


Stanford University 


G] 


ae [4] has described a “qualitative” 
Pears to D igen | the Maze Test which ap- 
delitiuense ect differences in test behavior of 
Scheme js ‘i a nondelinquents. This scoring 
ject’s ied ae on an evaluation of the sub- 
Pulsivitye r ‘ for instructions, carefulness, im- 
pressive e Essentially, it is a measure of ex- 
ing of the eae and differs from the scor- 

Studie on for intelligence ratings. 

rajales [1 Porteus [2, 3], Wright [5], and 
erences b ] have revealed very significant dif- 

elin sgh the qualitative performances 
only — and nondelinquents. However, 
Other een has tested nondelinquents, the 
Quent hors having accepted his nondelin- 

nt norms, (See Table 1.) 

o ee was conducted for the following 
delinquent (a) to provide additional non- 
vide an normative data, and (4) to pro- 
Eroups of independent study of “matched 

delinquents and nondelinquents. 


Procedure | 


Ps of 60 delings and (A nondelin- 
ace, and matched for age, -ntal ability, 

aze Tes oeconomic level, freve given the 
8roup fk st. The delinquent; comprising this 
Studied į re chosen for theif,similarity to those 
Were Ç n Previous investi ns. All subjects 
= Mucasians, and were between the ages 
Months S 10 months and 16 years, 10 
for the q ‘chsler-Bellevue intelligence ratings 
deling, lnquents ranged from 72 to 116. All 


Aque: 

x n 3 E 

eling ts were inmates in a state’school for 
Went boys 


I 


Grou 
Quent 


E ias 
Writ 
Orst Sts express their gratitude to Robert 
for ae the staff of the Fred C. Nelles 

YS at Whittie?, California, and to per- 


ae th ; 
tig, Ae Public Sr hool System of San Jose, 
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Nondelinquents were selected from the ninth 
grade of a junior high school and the tenth 
grade of a high school in San Jose, California. 
Their intelligence as measured by the Califor- 
nia Test of Mental Maturity ranged from 71 
to 128. In order to exclude noninstitutionalized 
delinquents from the nondelinquent group, the 
names of all subjects were reviewed by the 
school counselor and by the boys’ physical edu- 
cation teachers. Only those who survived this 
process of elimination were tested. While the 
delinquent and nondelinquent groups are by 
no means perfectly matched, it appears certain 
that the most striking difference between 
groups is that one is characterized by “good 
citizenship,” while the other is distinguished by 
its members’ persistent disregard for the rules 
of society. 

© Results 

The mean Q score (total weighted quali- 
tative score) for delinquents was 47, which 
does not differ significantly from 49, the cen- 
tral tendency of previously reported means for 
delinquents (Table 1). 


Table 1 


Q-Score Means and Sigmas for Groups of 
Delinquents and Nondelinquents 


Delinquents Nondelinquents 


Group N Mean Sigma N Mean Sigma 
Porteus [2] 100 49 25 100 22 13 
Wright [5] 54 49 28 ca ee es 
Grajales [1] 60 56 29 — — — 
Porteus [3] 50 48 22° 179 19 13 
Present study © 60 47 26 60 25 20 


The mean Q score for nondelinquents was 
25, as compared to 22 which Porteus reported. 
This difference of three Q-score points is not 
significant. The major finding, then, is chat the 


a 
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qualitative performance of delinquents and 
nondelinquents corresponds almost exactly 
with the results previously reported for such 
groups, and that the difference between the de- 
linquents’ and nondelinquents’ means yields a 
critical ratio in excess of five, which is signi- 
ficant at the .0001 level. 


Table 2 
Percentages of Delinquents and Nondelinquents 
Falling above Various Q-Score Critical Cutoffs 


Delinquents Nondelinquents 
Group Cutoff Percent Cutoff Percent 
above above 
Porteus [2] 29 20 29 21 
Wright [5] 29 78 — — 
Grajales [1] 22 92 = — 
Present study 29 70 29 30 


It is interesting to consider what predictive 
value this test might have. Porteus suggests a 
critical cutoff of 29 as the Q score which best 
discriminates delinquents from nondelinquents 
(Table 2). The writers found that of the de- 
linquents, 70% fell above 29, while only 30% 
of the nondelinquents scored above this level. 
On the basis of these consistent differences be- 
tween groups, this test shows promise of having 
predictive value, 

Porteus probably constructed his weighting 
scheme after observing differences between the 
mean incidence of weighted errors for the two 
groups. Table 3 permits comparison of the 
means given by Porteus with the results of the 
present study, and it is noteworthy that the 
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means reported by Grajales [1] and Wright 
[5] are very similar to these. 


In order to assess the appropriateness of the 
Porteus weights, chi squares were computed 
based on differences in error incidence between 
the two groups. All the qualitative errors arë | 
discriminating in the expected direction (delin- 
quents higher than nondelinquents), and of 
the basis of the magnitude of the respective chi 
squares, the Porteus weights appear to be rear — 
sonably assigned. Certain modifications could | 
be justified on the basis of these data, but such 
changes would be premature. 


That Porteus’ weights are not essential is sug- 
gested by two findings. First, the critical ratio be- 
tween the unweighted error means is 5.18, which i$ 
approximately the same as the critical ratio be- 
tween the Q-score means. Second, using an un- 
weighted error cutoff of 16, almost exactly the samt 
Percentages of each group fall above and below 2% 
when a Q-score cutoff of 29 is employed. It appears 
that the Porteus weights serve primarily to increas 
the magnitude of scores without altering the dif- 
ferences between groups. In the present study, the 
unweighted scores were: (a) delinquent mean = 
24.7, © = 13.2; (b) enondelinquent mean — 13.) 
o = 9.9. 

Unfortunately, there are no data available on thé 
reliability of this measure, but this study revealed 
a very high correlation between two scorers. Using 
the records of 60 nondelinquents, the product-m 
ment correlation was .98; the rank-difference corre” 
lation, .96. Had the records of delinquents bee” 
used, these correlations might have dropped as thé 
delinquents committed “ncie errors which were dif f 
ficult ta score objectively; on the other hand, thë 


increasea\range Sathe delinquents could comper” 
sate for ay “Ty, 
X 


Table 3 


Mean Incidence of Qualita 


c tive 
res for Differences between 


and Chi Squa 


Delinquent 


Errors, the Ey. See 


s’ and Nondvjnquents’ Performance 


Mean incidence of qualitative errors 


9 Nondelinquents Delinquents Porteus “ Chi square $ 
Porteus Present Porteus Present Weights 
[2] study [2] study h 
Firse third ©1.01 0.60 1.58 1.63 2 
Last third 0.77 0.60 . 109% 080 1 pe 2H 
Cut corner 3.01 3.15 4.40 4.61 1 ze a 
Cross line 318 3.50 5.93 7.68 2 ee a 
Lift pencil 1.63 2.80 5.77 3.81 A 13:04 pie 
Wavy line 134 1.10 3.68 4.36 2 oo 
Wrong direction 0.55 0.33 0.71 0.83 1 ~~ ee 
Year V. 0.27 «0.28 1.09 0.46 1 ASA n 
Year VI -0 W2 0.99 0.50 1 a a 
“2 .20 
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ae to which CG score correlates with in- 
wits se = a ‘vital question. The results of the 
the ea previous reports which indicate 
taken fie ie is low. For delinquents who had 
Ecne at senger Bellevue, the r was —.27, sig- 
Score te eet -05 level, The nondelinquents’ Q 
Siba m ated —.16 with the California Test of 
hice een Rot significant. These should be 
score is « as Positive correlations, since a low Q 
1s “good.” 
Pra cdl research the entire series of mazes was 
continuin Fire ey beginning witbiiyeat y a 
was derived sonal the adult maze. The Q score 
inteliga Ted from this sequence, but the Maze Test 
Portion eer was obtained only from that 
ieee is series which was applicable. ‘ 

mazes and aes require two trials on the easier 
iffcult one: ree or four trials to solve the more 
number of maze might be asked what influence the 
3 Meigs of administered has upon the Q score. 

e Ea mazes used was sufficient to justify 
etween PES a product-moment correlation 
Broups, he variable and Q score. Combining both 
o significa r was .29, which reaches the .01 level 
the variace of Therefore only about 9 per cent of 
m number P Q score is attributable to variations 
aaee res used, Te ip recommended that 
series, including the adult maze, be given. 
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Discussion 


that a accepts the empirical demonstration 
Rroups È test psychometrically distinguishes 
i of adolescent boys whose social behavior 
Questia to be different, there remains the 

n: What does the test measure? We 


Confes Rea 
tion a that a justifiable answer for this ques- 


which 


s 
e or rement of expressive movraents taps 

struct re personality variables “fated to the 
dec... ct Of ego-control. ae sag may best 
ter of respo“ises which con- 
score. Shoy:"d this be the case, 
ents ee idey the matter, in- 
Portant $ this kind woula apr -F to be an 
aSsessme, Ț ODtribution toward the objective 

ent of personality. 
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Delinquent Performance on the Porteus Maze Test 
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Summary 


1. Groups of 60 delinquents and 60 nonde- 
linguents were given the Porteus Qualitative 
Maze Test. The mean total weighted quali- 
tative score (Q score) for delinquents was 47 ; 
for nondelinquents, 25. The difference was sig- 
nificant at the .0001 level. 

2. Seventy per cent of the delinquents 
scored above 29; only 30 per cent of the non- 
delinquents exceeded this cutoff. The test 
shows promise of having predictive value. 

3. Porteus’ weighting scheme can be ration- 
alized and used, but does not seem to add to 
the efficiency of the test. 

4. A correlation of .98 showed reliability of 
scoring can be very high. 

5. For delinquents, Q score correlated —.27 
with intelligence, significant at the .05 level. 
For nondelinquents the correlation was —.16, 
not significant. 

6. Q score correlated .29 with the number 
of mazes used, significant at the .01 level. 

7. This test may measure personality vari- 
ables, such as impulsivity, related to the con- 
struct of ego-control. 


Received April 6, 1953. 


© References 


1. Grajales, M. C. Porteus’ Qualitative Maze Test 
as a measure of delinquency. Unpublished mas- 
ter’s thesis, Fordham Univer., 1945. 

2. Porteus, S. D. Qualitative performance in the 
maze test. Vineland, N. J.: Smith Printing 
House, 1942. 

3. Porteus, S. D. Q-scores, temperament and de- 
linquency. J. abnorm. soc. Psychol., 1945, 21, 
81-103. 

4, Porteus, S. D. The Porteus Maze Test and in- 
telligence. Palo Alto, Calif.: Pacific Books, 1950. 

5. Wright, Clare. The qualitative performance of 
delinquent boys on the Porteus Maze Test. Ua 
consult. Psychol., 1944, 8, 24-26. 


Books 9 


Brown, Judson S., Harlow, 


Harry F. Postman, Leo 
J» Nowlis, Vincent, 


Newcomb, Theodore M., 
& Mowrer, O. Hobart. Current theory and re- 
Search in motivation: a symposium. Lincoln: 
Univer. of Nebraska Press, 1953. Pp. v + 193 
(paper). $2.00. 


You will want to read this one. The six able 
contributors to the symposium are at their best and 
are, in the order named, as predictably Hullian, 
experimental, perceptual, developmental, social, and 
two-factored as you might expect. Would the sub- 
ject matter were as predictable as the protagonists! 
But they shed more light on the complex problem 
of motivation than has been shed in many a moon. 
If you are interested in psychological theory, send 
to Nebraska for your copy — now, — L.F.S, 


Daniel, Robert S, & Louttit, C. M. Professional 
problems in Psychology. New York: Prentice- 
Hall, 1953, Pp. xi + 416. $5.50. 


‘aduate 
ds of psychology. It con- 


their subject 
bibliography, 
organizations, 
style is clear 


training, history, 
ion, Publication, 
nd the like. The 


Ethical Standards of 
It is in agreement with these documents a 


esirable duplication, 

is available there 
should be more and better orientation Courses for our 
students, And many already-gradiated psycholo- 


gists may read it with enjoyment and Drofiz, too, — 
LFS. 
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Doll, Edgar A. The measurement of social compe- 
tence: a manual for the Vineland Social Maturity 
Scale. Philadelphia: Educational Test Bureau 
1953. Pp. xviii + 664. $7.75, 


The Vineland Social Maturity Scale is an un- 
usual psychological instrument, not a test but 4 
method for quantifying observations of social ma- 
turation. It is one of the few devices that can be ap” 
plied reliably and usefully in the absence of the ex 
aminee from the reports of persons who have ob- 


served his developmental achievements, The Scale 
available since 1936 


prehensive manual 
The manual describ 
tion of the scale, its 
its standardization 
draws both from his 
the published research of others. Most of the evi- 
dence supports the value of the Scale: its good re 


e scaling of items, and 
Practical and research 
of a shock, however, t° 
dardization is based 0” 
S, 10 male and 10 female, at each ag? 
ity of cases is offset by the 
n selecting the normativ® 
porting data from consecU” 
like the Scale, has many 
merits and a few cledr “shortcomings, The com 
of the data presented, and the cautiousnes$ 
of the intexpretatidns may serve as models for othe! 
test author On the rative side, the manual 
while attracti. ę in appear: 
to make essenù 
seems to provide 
diligent Searcher, }\ 
The Social Maturi} 
maturity, and sho 
ical tool as‘tne intelli 


the inde* 
“Tustration as often as help. The 
ever, is ultimately rewarde®’ 
yale has now come to its ow? 
_‘seome as essential as a clin 
gence test. — L.F.S. 
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arsden, Steps in Psychotherap York’ 
e y. New 
Macmillan, 1953, Pp. ix + 222. $3.50. 


orient the reader to the 

therapy, “a blend of rein 
inent learning theory and psychoanalysis,” and 
aa Proceed to demonstr; te the implications of tb¢ 
rp for Practice by pr senting selected portions 
of the seventeen recorded therapy sessions constitit 
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hoe psychotherapy for a 40-year-old married 
larel Bene Discussion of these materials is 
raed terms of the recorded comments of the 
pist (an EDR (Dollard) | to the young thera- 
visory ME ee psychiatrist) during the super- 
EL neal na art II includes the complete pro- 
the first a attery of tests administered between 
Bendent sei ae iep hours and two inde- 
chologists s a ti interpretations by clinical psy- 
pee i, = written with and the other without 
authors de uiai of the first therap, ion. The 
peutie or ane claim validity for either the thera- 
raw EEE NEA procedures but rather offer these 
Proaches to ia and their ideas as promising ap- 

© book sh a development of better knowledge. 
Seminar a be extremely useful as a basis for 
i ‘cussions and of interest to all psycholo- 
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Pists, Ae with the training of psychothera- 
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D. xix, Methuen, and New York: Wiley, 1953. 
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Eysenck 
person ck’s most recent contribution to the study of 
than a ean eee of research. But it is more 
hich Bae it is a critical and creative integra- 
tative Studi rings order to a diversity of quanti- 
the Prime Rae Eysenck espouses factor analysis as 
Personality, Ta for revealing the organization 
e identifies a a an introductory chapter on theory 
Second-order farorder factors with “traits” and 
€vidence jg. tors With “types.” The research 
anged acco ered in a series of chapters ar- 
Ployeq; : rding to the technique of appraisal em- 
measurement E? questionnaires, objective tests, 
attitude cea of physique, physiological indices, 
Etwee Berane measurements, and correlations 
ba imes ithe Many studies are reinterpreted, 
TINE’ a semb] new analyses of their data, so as to 
¥ consid er ance of agreement to results revious- 
dulge in om Contradictory. Eysenck d not in- 
blows he zi Petty virtue of impartiiity but the 
are fair wae his opponents, whilf often severe, 
Psycho ie well aimed. The boo! will appeal to 
essed ge and students who „refer theory but- 
R: may ao Earth to vague fcofessions of faith. 
™ and agree with ey, p vord but they will 
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Are) & Katz, Daniel. (Eds.) Research 
1 E behavioral sciences. New York: 

- ix +660. $5.90. 
ous ting polun investigative techniques, this 
Seana pt to es represents a serious and vigor- 
T Proble: Clarify the logie of a numbir- of re- 
Sam a aa in the sciences of individual and 
Perin è Survey behavior, Such methods as the 
Are Ment i the field st ‘dy, and the formal ex- 
adya lyzed i both field and laboratory conditions 
“ages oi terms of their advantages and dis- 
respect to various substantive is- 
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sues in social and psychological theory. Two chap- 
ters are devoted to the technical problems of sample 
selection and distribution-free statistical procedures, 
both of which should prove especially meaningful 
for research workers in clinical psychology and in 
the psychology of personality. One section deals with 
techniques of observing group behavior, of using 
documents and census records, and of collecting 
usable data by.interview. On the analytic side, there 
are contributions on the use of qualitative data and 
on the theory and methods of social measurement. 
While it is a little unfair in a book of such re- 
markably even and high quality to give special 
mention to particular sections, Helen Peak’s chap- 
ter on the general problem of making objective ob- 
servations could profitably be read by every grad- 
uate student in the country. Similarly, the conclud- 
ing chapter by Likert and Lippitt on the utilization 
of social science is an insightful discussion, at once 
seminal and sound, of the neglected problem of how 
research results can be most fruitfully capitalized 
upon both by other researchers and by applied 
workers and citizen leaders. This book will richly 
repay serious and repeated consideration by psy- 
chologists of very different theoretical persuasions 
and specific investigative interests. — £.J.S. 


Hathaway, Starke R., & Monachesi, Elio D. (Eds.) 
Analyzing and predicting juvenile delinquency 
with the MMPI. Minneapolis: Univer. of Minne- 
sota Press, 1953. Pp. viii -+ 153. $3.50. 


A research monograph containing six studies 
based on the complete testing of a ninth-grade 
group vith the MMPI in 1947-48, and a subsequent 
comparison with police and court records. Moder- 
ate relationships between some MMPI indicators 
and delinquency were found which can be inter- 
preted with the aid of expectancy tables. The most 
valid prediction was the nondelinquency of young- 
sters with clearly normal profiles. A valuable side 
product of the study is a useful amount of data 
about adolescents in general. — L.F.S. 


Kinsey, Alfred C., Pomeroy, Wardell B., Martin, 
Clyde E., & Gebhard, Paul H. Sexual behavior in 
the human female. Philadelphia: Saunders, 1953. 
Pp. xxx + 842. $8.00. aš s 


There will probably be as many lines of type set 
about this book as there are in it, which should 
make a reviewer cautious lest he review its stimulus 
value rather than the volume per, se. The book_is 
similar ip, many respects to the 1948 report on the 
male. It differs in that it does not contain the large 
part on “factors affecting”; instead, a part is de- 
voted to a comparison of the sexes. The Kinsey 
team admits it has not undertaken “U. S. correc- 
tions” of the raw data. However, there is a point- 
for-point comparison with male results, which 
raises questions about the significance of these gen- 
eralizations. The authors frenkly aumit the inad- 
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equacy of their sample, especially for females who 
have not gone beyond grade school. Female sexual 
behavior is studied with orgasm and erotic arousal 
as the dependent variables, with age, education, 
marital status, occupation, religious and rural-ur- 
ban backgrounds, age of onset of adolescence, and 
decade of birth as independent variables. In the 
male study mere sexual arousal was not included as 
a variable. Religious background end decade of 
birth were conspicuously important variables; age, 
a very important variable in male outlet, was re- 
lated differently to female behavior. Males were 
found to be conditioned by sexual experience more 
frequently than were females, and they share vicar- 
iously in the sexual experiences of others to a greater 
extent. The data for youth show majority behay- 
ior following somewhat the course dictated by 
cultural pressures. Kinsey and his associates did 
more than report findings. They suggested social 
implications which go beyond the scope of their 
molecular study. Whereas the authors generally 
seemed to show scientific caution and scholarliness, 
some of the earlier criticism of the limitations of 
their method does not seem to have influenced the 
second study greatly. — F. McK. 


Lehman, Harvey C. Age and achievement, Prince- 


_ton, N. J.: Princeton Univer, Press, 1953. Pp. xiii 
+ 359. $7.50. 


Psychologists will be grateful 
which brings tog 
Penetrating studi 


statesmen are getting ol 
others as interesting, 
ful studies. The “whys” 


Peck, Leigh. Child psychology. Boston: Heath, 
1953. Pp. 536. $5.25, } 
Child Psychology is planned for college students 

on the undergraduate level, The author has cen- 

stantly kept in mind the special needs of students 

preparing to wor’; with children, and has given a 

comprehensive picture of psychological © develop- 

ment. It is refreshing to find a bookethat makes its 
subject matter such delightful reading for the 
group for which it is planned. Pertinent reports of 
actual situations illustrate the discussions and help 

g. The arrange- 

and index are ex- 

ve helpful in an in- 
hild development. — BML, 


the reader clarit, his own thinkin 
ment, organization, references, 
cellent and the book should pro 
troductory course in å 
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Piaget, Jean. The child’s conception of ne 
New York: Humanities Press, 1952. Pp. ix 
248. $5.00. 


This is a translation of a book previously pub- 
lished in French some twelve years ago. Piaget S 
naturalistic approach to the mind of the child 38 
here applied to his development of the numba 
function. As usual, Piaget has included materin 
from the original protocols, and the book makes mi 
teresting reading for the psychologist. The pesua 
ing clinician will get more insight here into t 4 
functioning of the child’s mind in a testing situa 
tion than he will from the abstractions of factor 
analysis. The translation is good and the formaty 
pleasing. — W.A.H. 


Powdermaker, Florence B., & Frank, Jerome Pi 
Group psychotherapy. Cambridge: Harvard Uni 
ver. Press, 1953. Pp. xv -+ 615. $6.50. 


This is a detailed report of two experiments in 
group therapy. Both studies were conducted unde 
the auspices of the Washington School of Psychiatry: 
one with 124 VA clinic patients, mostly neurotic 
and the other with 88 VA hospital patients, mostly 
schizophrenics. Only for the psychotic group was E 
control group used. The magnitude of the exper! 
ment can be seen from the fact that 24 “medic? 
doctors” were involved (10 of them psychiatrists)? 
5 clinical psychologists, and 2 Psychiatric soci? 
workers. There were 12 groups in the clinic exper!” 
ment and 15 in the hospital, In the neurotic group! 
453 sessions were studied. The major method em” 
ployed was the situational analysis of Sroup meet 
ings, developed from Harry Stack Sullivan's col” 
cept of situations as bases of human behavior, THe 
analyses make excellent teaching (and learning) 
material, An equally valuable portion is an appe” 
dix with a running account of the first and the 
65th meing of one group. Situations are also pre 4 


sented to Youstrate préresses in the conduct of grouk., 
therapy. On? 


‘had no previous clinical training 
but they were periNitted to do “psychotherapy” W! it 
‘according to the authors, th? — 


e 
ed out to be an adyantas® 


Sargent, Helen D. The Insight Test, Menning“ 
Clin“ Monogr. Ser, No. 10. New York: Grune * 
Stratton, 1953, Pp. xli\t 276. $6.75, 


Sargent has supplied,a more complete manual fof 
her ingenious Pencil-and-paper Projective meth? 


be first described in 1944. In the test, sub- 
| tins. are a ig ae to described conflict situa- 
Mand eas or expressed affect (4), defense 
scores under ee ae (M) and for several sub- 
use is made a of these main categories. Much 
the cere and ow ratio A/D. The manual gives 
scoring, and areas the test, its administration, 
Protocols Je ep aa and copious illustrative 
judged be uke ae rom seven clinical groups. When 
method ‘nipped of a quantitative test, the 
Scoring reliability meager support. Although the 
test reliabilit A of trained scorers is ‘good, the re- 
adequate Rie subjects is reported only for in- 
to mediocre Th and even then ranges from poor 
ards are based normal” group, on which stand- 
Students, Obvio comnts, of 20 screened university 
tom such Whine y „evidence that patients differ 
Blves evidence rmals” has no value. The author 
discusses the of being a competent statistician, and 
tion ae for controls of age, sex, educa- 
b EA G status but does nothing 
eally believe in air inference is that she does not 
x course, Ei ag See evaluation. The test, 
Nica] Protocol e judged by other criteria, The 
tile unches ols reveal it as a rich source of fer- 
“earch eyid about psychopathology. Until better re- 
est ence is produced, however, the Insight 
must reniat "n however, the E nsig. 
Potheseg tha: ain a better device for making hy- 
n for testing them, — L.F.S. 


Morri es 
Ustry Nee S. Motivation and morale in in- 
$9.50, Ww York: Norton, 1953. Pp. xvi + 510. 


Thi 
t S volume 
“is deyo me, 


written pri i a 
cal ted to a primarily for management, 


men, Valuation comprehensive description and crit- 
etl Studie of American and British experi- 
a Sources, SE and attitude surveys bearing upon 
ues in indi aionsand the determinants vf 
exten, ibliographien It is indeed comprehensive and 
Wis ve Orie h at the end of each chiipter are 
works e ae -in motivatic 1 theories 
incenti iscussed oblem ‘of mobilizing the will-to- 
tive system with particular refgrence to wage- 
Work of Such a Studies on the effect on produc- 
8roup, kn ‘lables as job. „reference, size of 
pa lowledge of rer fg, superyision, and 
mae lig aleg 1 iPation ajo P vered effectively. 
a ial Eo ¢ Mab ioyc- “itude sur- 
the op tions df ne on guideposts for management, 
€r techni application of such surveys and 
ques discussed. — A.R. 
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K Pinch mann, F., & Betts, G. 1. Kuhl- 


a on Melligence Pests. Renee 26 

Tay ($1.95 each level. 25 (30) min..Test 

sb gy PSWer Rhee, 25) vith instructions, keys; 

Phig 7 ($1.00) ae (95¢ per 25); manual, pp--V 

ucatjo, _ “Pecimen set ($1.50). Philadel- 
tonal Test Bureau, 1953. 
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The new series of tests bears only a superficial 
resemblance to its predecessor, the Kuhlmann-An- 
derson. The tests consist of entirely new items 
planned by Kuhlmann and developed after his 
death by Finch. Each booklet has five subtests with 
lenient five-minute timing. Nonverbal tests are used 
through grade 3, and two verbal subtests, two non- 
verbal, and one numerical at the higher levels. MA 
and IQ scores are obtained from charts in the book- 
lets, with littlečlerical effort. The manual gives only 
10 pages to the construction and standardization of 
the test, and there are no references to research ar- 
ticles. While not extensive, the technical data give 
a decidedly favorable impression. Items were se- 
lected not only to yield progressive age increments, 
but to be as free as possible of cultural and sex 
biases. Reliabilities are good (.86 — .92); norms 
are based on large and widespread samples. Data 
on validities, except against the general develop- 
mental criterion, are still lacking. — LFS, 


King, Joseph E., & Wingert, Judith W. IPI Merit 
Rating Series. Industrial employees. 5 scales, cler- 
ical, mechanical, sales, supervisor, technical. Rat- 
ing form ($4.00 per 20); manuals, pp. 20, 8; 
specimen set ($3.00). Tucson, Ariz. (Box 6056): 
Industrial Psychology, Inc., 1953. 


The Merit Rating Series applies a psychological 
test concept to the rating of employee performance. 
In place of the usual rating scale, 60 statements 
are provided in the form for each job family. The 
rater marks each statement yes or 70, and weighted 
scoring yields quantitative scores for several per- 
formandé traits and for over-all competence, The 
manuals discuss the methods of rating, training of 
raters, and application of results. At least minimally 
acceptable data are given on item difficulties and 
consistencies, the derivation of weights, and norms. 
In addition to supervisory uses, the method seems to 
be of potential value as a criterion for studies of 
personnel aptitude and selection. — L.F.S. 


Books Received 


Abrahams, Joseph, & Varon, Edith, Maternal de- 
pendency and schizophrenia. New York: Inter- 
national Universities Press, 1953. Pp. 240. $4.00. 


Marie. Female sexuality. New York: In- 


Bonaparte, 
Pp. x + 


ternational Universities Press, 1953. 
225. $4,50. 
Cottle, Wm. C. The MMPI: a review, Lawrence, ~ 
Kan.: Univer. of Kansas Press, 1953. Pp. yi + 
82. ” 
Donahue, Wilma, Rae, James rk Berry, Roger 
B. (Eds.) Rehabilitation of :e older worker. 
Ann Arbor: Univer. of Michigan Press, 19°3. Pp. 


v + 200. $3.25. : š 
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Ginzberg, Eli, Herma, John L., & Ginsburg, Sol W. 
Psychiatry and military manpower policy. New 
York: King’s Crown Press, 1953. Pp. xi + 66. 
$2.00. ; y 

Greenacre, Phyllis. (Ed.)- Affective’ disorders. New 
York: International Universities Press, 1953. Pp. 
212. $3.00. d 

Heston, Joseph C. How to.take a test. Chicago: 
Science Research Associates, 1953, Pp. 47. 40¢. 

Ingram, Christine P. Education of jhe slow-learn- 
ing child. New York: Ronald, 1953, Pp. ix + 
359..$5.00.:° + ` F F a 

Kahn, Alfred. Æ court for children. New York: 
Columbia Univer; Press, 1953. Pp. xxii -+ 359. 
$4.50. Ea ? 

Leitner, Konradi. Hypnotism for professionals. New 
York: Stravon, 1953, Pp. 127. $4.00. 


Little, Wilson, &- Chapman, A. L. Developmental 


guidance in- secondary school. New York: Me- 
Graw-Hill, 1953. Pp. ix + 324. $4.50." 
Nichtenhauser, Adolf, Coleman, Marie L., & Ruhe, 
Dayid S. Films in psychiatry, psychology and 
. mental health. New York: Health Education 
‘Council, 1953. Pp. 269.. $6.00. 7 
Prosser, Charles A., & Sifferd, Calvin, S. Selecting 
+ an occupation. Bloomington, Ill.: McKnight & 
McKnight, 1953. Pp. x + 246. $2.50. 
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Ralli, Elaine P. (Ed.) Acrenai cortex (Transactions | 
of the Fourth Conference, i952). New York: Jo 
siah Macy, Jr. Foundation, 1953. Pp. 165. 


Reik, Theodor. The haunting melody. New York: 
Farrar, Straus, & Young, %953. Pp. viii + 376. 
$4.00. $ 

Sartre, Jean-Paul. Existential psychoanalysis. New 
York: Philosophical Library, 1953. Pp. vill 
275. $4.75. * 

Serog, Max. New light on dreams. Boston: Hous? 
of Edinboro, 1953. Pp. 159. $3.00. 

Tyler, Leona E. The work of the counselor. “a 
York: Appleton-Century-Crofts, 1953. Pp. = | 
323. $3.00. - } 

Vernon, Philip E. Personality ‘tests and assessmem® 
London: Methuen, 1953. Pp. ix + 220. $4.00. 

Whitaker, Carl A., & Malone, Thomas P. The rool! 
of psychotherapy. New York: Blakiston, 1953. Pp 
xvii + 236. $4.50. - 

Wortis, Joseph. (Ed.) Basic problems in psychiatr 
New York: Grune & Stratton; 1953. Pp. vi 
186. $4.50. 

Yost, Orin Ross. What you should know abo 


mental illness. New York: Exposition Press, 19 
Pp. 165. $3.50. 


a 


lournal of Consulting Psycholog 
ar 18, No. 3, 1954 ee 


a 


Prognostic Factors in Schizophrenia ` 


William Schofield, Starke R. Hathaway, Donald-W. Hastings, 
and Dorothy M. Bell ; 
f University of Minnesota ~ 


of the status of a given sample of patients at -~ 
some period following hospital admission or > 
discharge. The worker wishing to review spe- 
cifically prognostic studies labors under some >.» 
difficulty because of the fairly widespread ten- at 
dency of investigators to use the term “prog- ~ 


nosis” in studies which are purely statistical ~ 


Re ae p: a magnitude of the problem 
schizophren’ the psychiatric enigma known as 
tively fle a it is startling to find how rela- 
E oe attention has been paid to 
ee ates outcomes in this illness and how 
made inte ensive investigations have been 
$ Prognostic factors. A reasonably ex- 


austiye . 
outcome review of the research literature on reports on “outcomes,” with no effort to an- œ 
Veal, and prognosis in schizophrenia re- alyze factors related to outcome. `i 


So x n í 3 x 
nly 31 published studies in this country No attempt will be made in this paper to ~~ 


tween > 
Port per 1909 and 1951 — less than one re- present a detailed review of the literature «7 
of on] year. These 31 studies cover a total summarized above. A comprehensive review of ~~ 
. . * . .- 
the published studies on outcome and prognosis $ 


lia AN 802 Patients (exclusive of Pollock’s 
i ps review of 19, 927 patients), the 
10 es ranging in size from 20 to 
tery, rR The length of the follow-up in- 
With an ngad from zero to fifteen years, 
One-ha] verage of approximately four and 
‘Specify aes in those studies which clearly 
Studies a length of follow-up. Of the 31 
Used Seapets fewer than one-third have 
tlents as a 1, ace-to-face contacts with the pa- 
gal: temainde, 18 for the fellow-up evaluations, 
' Sponses and le relying on questionnaire re- 
Pi variability fo In view of the extent of 
“ngth of lle in the factors of sample size, 
UP evaluat OW-UP Period, and basis of follow- 
y ogra” it is not surprising that the fig- 
to for “recovery” rate range from 
Tate ext 0, and that those for “improvement” 
è Ta from 5 to 74%! 
Vesti ee the literature reveals that true 
-*8certain ¢ © Mto prognosis, i.e., attempts to 
Soe ou oe differentiating patients with 
F sae small from those with poor, constitute 
les, t © ma} Proportion of the follow-up 
ajority of which are sirnple reports 


. W3 stud 

Paper ls ie pa made possible by the Frederick 
192cho] as tend oe Funds A condensation of this 
259 "Bical Age’ the Aecting of the American 


S; iati . 
sociation, Washington, September, 
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in schizophrenia, with a detailed bibliography, 
has been prepared for separate publication ; the 
European researches are included in this re- 4 
view. However, it is appropriate here to call 
attention to a few papers which have particu- 


lar import. In 1938, Romano and Ebaugh [8] | A 


published one of the earliest of the few studies 
in which both questionnaire responses and the 
results of direct re-examination were available 
for the same sample of patients as bases on ` 
which to appraise their postdischarge status. 
Comparison of the results of direct examina- 
tion with questionnaire data from the families 
showed significant error in over 50% of the 
cases for which both types of data were avail- 
able. 

“ The paper by Malamud and Render [6] is 
important on a number of counts. It is one of 
the few studies that recognizes the marked dis- 
crepancies among the “recovery and improve- 
ment” statistics previously reported, and it re- 
views the possible sources of thzse discrepancies. 
It is coticerned with an actual attempt to dis- 
tinguish. be:ween schizophrenics with poor 
and good outcomes, respectively. It is based 
on a sample of over 300 patients and eval- 
uates their status after an average postad- 
mission interval of -six years. Most impor- 
tant of all, the follow-up eyaluation was 


” 
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l ý f an erai 
i ination ; a- based were collected ‘as Part o i 
based-on direct re-examination; and all p Ana WAS Hi EAS aa D 


tients had been originally examined by one of 
investigators. 

=" 1941, Chase and Silverman Bi reported 
a “critical survey of the literature’ _on prog- 
nostic criteria in schizophrenia. This was by 
no means a comprehensive review, since the 
reference list of 49 items failed to include 15 
of the 30 follow-up studies published in the 
United States through 1940. Thus, the degree 
of agreement or disagreement as to the prog- 
nostic value of particular items might actually 
prove quite different from that indicated by 
Chase and Silverman in their limited survey. 
Discussing the findings of various studies un- 
der 15 different factors, they include that def- 
inite prognostic value attaches to the factors 
of duration of illness, acuteness of onset, 
Presence of obvious exogenic precipitants, 
fusion and atypical symptoms, “process” 
toms, and subtypes. The survey 
questionable or no prognostic validi 
factors of age, sex, 
tory, previous episo 

à introversion, 
is not exhaus 
very limited 
` research stud 
One of th 


con- 
symp- 
suggested 
ty for the 
education, psychosexual his- 
des, body type, extroversion- 
and heredity. While this review 
tive, it does help to indicate the 
number of factors on which the 
ies are uniform in their findings, 
e most thorough reviews of the 
literature on Prognosis was published by Blair 
[1] in 1940, This is Particularly good with Tre- 
Spect to the European studies, although it is 
n its coverage of American re- 

rimarily concerned with “spon- 
n” rates as a base line for eval- 

€y of cardiozol and insulin ther- 


searcl. for prognost 


The criterion data on which this Study is 


z and D. M. Bell 
W. Schofield, S. R. Hathaway, D. W. Hastings, and D. 
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ln 1949, a graduate social worker tained 
in research traveled throughout Minnesote 
to interview patients who had been hos- 
pitalized on the psychiatric service of the 
University of Minnesota Hospitals between 
1938-1944. This interval was chosen heraus 
it covered the period from the inception 0 
the psychiatric service to the start of oe 
tensive utilization of electric and convulsive 
therapies. Thus, data on the subsequent 
adjustments of patients evaluated in this study 
permit appraisal of the effects of psychiatri¢ 
hospitalization exclusive of the shock therapi® 


' s : t 
which have assumed a major role in recen | 
years. 


The social worker succeeded in establishing | 
contact with the patient directly, or with clos? 
relatives, friends, and neighbors, or with well- 
informed agencies in the home community, 1 
77% (1,261) of the total of 1,638 cases treate 
during the 1938-1944 interval, In terms of the 
frequency of the various diagnostic categories 
the 77% sample was found to be essential 3 
identical with the total original group of hos 
pitalized patients. Schizophrenics constitut 
14.1% of the original group and 16.79% of E 
group with which follow-up contact K. 
achieved. Of the 16 diagnostic groups rep" 
sented in the total follow-up sample, ó 
schizophrenics ranked Second for percentage '. | 


> nti 
follow-up contact; 87.5% of the 240 ee 
hospitalized in the interval under study WE 
traced 


: i 
by the social worker. General gl 
tive data for these patients are reported 
Table 2. y 
i u 
A word should be said concerning the nat 


Ai 
A 
; p 
of the treatment received by the schizophr® 


patients. They were hospitalized for an n i 
age of 40 days (M = 39.9; o= 30.1) ie 
small lec 


i | 
service was 


at 
ked ward (35 beds). The psych!# inf 
unit with 


In the as 
ficial ros 


aes $ : cha 
Primarily a diagnostic and a sta i 
va small, eclectically oriente f of 
signment of formal diagnoses 


ological system of the America® $g | 


yd 


. + . B. us 
chiatric Association was applied. The d 
medical facilities of 2 psychiatric hospit# ehy 
available and were wed as indicate eft 


. e iV 
sedatives, hydrotherapy, nursing manag fat 
of regimen, etc.). Occupational theraPY | 
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ities were available and were used extensively 


in the treatment program; general recreational 
facilities were extremely limited. Because of 
She small sali and the generaly diagnostic 
Orientation of the unit, psychotherapy was of a 
Most limited nature. No use was made during 
the interval under study of convulsive or 
shock” therapies. It might reasonably be held 
that recovery and improvement figures for this 
sample would reflect relatively “spontaneous” 
remission, and that factors found to differen- 
tiate between those with good and those with 
Poor posthospital courses might be used to 
equate later patient groups for study of the 

cacy of specific therapies such as insulin 
shock, 


Procedures 


On the basis of interviews and hospital rec- 
ords for those cases in which rehospitalization 
Phe occurred, the social worker assigned a rat- 
dif to each patient to indicate the degree of 
< aculty he had experienced in his over-all ad- 
et Subsequent to his hospitalization at 
ae o Yenity: A five-step rating scale was 

» With each step defined as follows: 


= Patient had no further trouble of the type for 
he Was hospitalized originally. : 
justmese enta were largely making a good social sr 
by the t. To a small extent they had been bothere 
Pitalizae aits they presented at the time of ie 
othered th, but these occurred very nace 
Bree, or ne Patient or his family to a minimal A 
Within pa gradually diminished and disappear 
Patients D year following hospitalization. _ 
Pitals owe, have spent a short time in a state a 
hospitali it was immediately following initia 
Was. so ation at the university, and the patient 
n paroled and never returned. 
m A were in and out of state hospitals, 
ut had | nae made a good adjustment for a time 
SPital; relapses of the illness for which they were 
Well ẹ Zed. Although these patients had been 
ly had Telatively long periods of time, they usual- 
ate three episodes of illness. . 
‘ts had spent more than half of the time 
Mstituty, tsity hospitalization and follow-up in 
ae Netio, On, incapacitated because of the illness, 
J Sterize ning on the inadequate level which char- 
siiig them at the time of university bospitali- 
‘amily en the most part, the patient or the patient's 
e, Sidered him to have a large amount of 


betwe unive 


Pati 

wi ie had continuous trouble of the type 
they were hospitalized. Many of them 
rom the university hospitals directly to 
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a state institution, and they remained there. Others 
were cared for at home by their families, but none 
of them recovered even for a short while, 


Tahle 1 presents the distributions of the fol 
low-up ratings for the total sample of 210 
schizophrenics contacted. In comparing the fig- 
ures of this table with those in the existing 
literature, it should be noted that the criterion 
of evaluation applied in this study was not one 
of degree of psychiatric symptomatology, but 
rather one of social adjustment, and that the 
interval of posthospital adjustment ranged 
from five to eleven years. 

Schizophrenic patients who fell into the four 
extreme categories of rated posthospital adjust- 
ment (A and B, D and E) constituted the cri- 
terion groups in a search for prognostic factors. 
Adequate case history data and clinical notes 
were available for all of the A and B cases and 
for all but seven of the D and E cases. The 
criterion groups were thus composed of 58 pa- 
tients who had no further difficulty of the type 
for which they were originally hospitalized or 
who were making a good social adjustment 
(Good group), and 119 schizophrenics who 
had spent over 50% of the time since their uni- 
versity hospitalization in a mental institution 
or who had experienced continuous difficulty 
necessitating their being cared for by their 
families (Poor group). 

The hospital records and case histories of 
the 178 schizophrenics were next analyzed, 
with reference to a very detailed schedule for 
notation of presence or absence, or a rating of 
the degree, of some 250 items covering personal 
history, medical history, and development and 
features of the psychosis.? A random selection 
of records was independently rated on the 
case history variables by two raters. Complete 
agreement as to rating was found to obtain on 
between 80% and 95% of the items in indi- 


2Copies of the 12-page rating schedule for case 
history analysis and of the 4-page record form used 
with it have been deposited with the American Doc- 
umentation Institute. Order Document No. 4209 from 
ADI Auxiliar Publications Project, Photoduplica- 
tion Service, “Library of Congress, Washington 25, 
D. S., remitting in advance $1.25 for microfilm or 
$1.25 for 6 x 8 in. photccopies. Make checks pay- 
able to Chief, Photoduplication Service, Library of 
Congress. 

This schedule was originally developed by W. 
Grant Dahlstrom in connection with an unpub- 
lished doctor’s dissertation [*]. a 
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Table 1 


Rated Posthospital Adjustment of Schizophrenics 
Who Received No Specific Form of Therapy 


Adjustment rating N Jo of group 
A (best) 14 7 
B H 21 
c 26 12 
D 29 14 
E (worst) 97 46 
7 Total 210 100 


vidual records. Free use was made of an “un- 
known” category in order not to introduce in- 
validity by forcing ratings on variables for 
which data were frequently inadequate. Rat- 
ings of the case histories were made without 
knowledge of which records belonged to which 
outcome group. 

The case histories provided adequate data 
for a sufficient number of patients to permit 
statistical analyses of the differential appear- 

~ ance of 200 items in the two criterion groups. 
į Basic data derived from the four parts of the 


~ jp case history analyses are reported in Tables 2- 


Ld of the data reported in these ta 


i 5. While it is clear from inspection that much 


i te data bles has no prog- 
nostic significance, it is presented in detail as 
normative statistics which describe the manner 
in which the clinical material of schizophrenia 
presents itself. It is hoped that these data may 
serve as an addition to the textbook de- 
scriptions of this psychosis, which generally are 
unsupported by such surveys, 

Of the 200 items statistica 
17 met the 5% level of reliability. While this 
number of positive findings, and their content 
is such as to argue against mere chance [2], 
the fact that only 17 distinctions should be 
yielded by 20G items attests to the subtlety of 
the social and personal factors determining 
postpsychotic adjustment. 


lly tested, only 


m - Results 


Table 2 presents general de-criptive data 
for the groups with good and with peor post- 
hospital adjustment, and for the two groups 
combined. The age variable is age at the time 
of hospitalization. The Good group has both 
a lower mean age at hospitalization and a re- 
liably more restricted age range than the Poor 
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A 
group (F = 1.553; p <.01). As is to be ex- 
pected, these differences are paralleled by the 
data on “age at onset” (Table 3). The Good 
group is younger at age of onset and has a re 
liably smaller variance on this variable than 
the Poor group (F = 2.293; p < .01). 

As further shown in Table 2, the two out: 
come groups are not differentiated by factors 
of sex, urban versus rural home, education, Te 
ligion, marital status, number of children, and | 
number of siblings. While the Good group 16 
characterized by nearly twice the proportio” | 
of catatonics as the Poor group, the distribu- ' 
tion of the various subtypes in the two out | 
come groups is not reliably different (g = 
9.12; p < -10). 

Of the thirty items of personal history te 
corded in Table 3, only four discriminate be 
tween the two groups. The Poor group is chat 
acterized by a reliably higher frequency of ¢*” 
cellent deportment in school (x? = 7.82; A 
< .02). The Good group reveals a reliably 
higher frequency of church attendance (7? A 
9.67; < 01). The marital adjustment of th? 
Good group is clearly superior to that of thé 
Poor group, showing no incidence of “extrem 
frustration” or “continual conflict,” and neat 
ly three times as many “pleasant” marital rel 
lationships are recorded for the Good grouP. 
as for the Poor, Affection toward the mat? 
was manifested by nearly all of the marti¢ 
schizophrenics with -gead outcome (94.19%)! 
and by only 50% of those in the Poor grou? ' 
(= 4.17; » < 01). 

In view of some of the prominent thinkin’ 
concerning psychogenic etiology, it is of oy 
siderable interest to note from Table 3 th 
the two groups are not different with resP° 
to interparental relationships, relationship wit 
cither parent, relationship to sibs, or sibling 
rank (Items 1-5). It is also interesting to 9° 
that they are not differentiated by the exter 
of social Participation (Item 13), by t of 
heterosexual adjustment (Item 19), of jst 
their initiative, social intelligence, and Po, 
(Items,22, ¢, f, and g). pe 

Table 4 reviews the data descriptive of A 
presenting illnesses of the schizophrenic 
tients. As noted above, ithe patients with 2° a 
Outcome were characterized by a reliably oa 
ler range of age at onset (Item 7). The du 
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Table 2 


Gross Descriptive Data for Schizophrenics with 
Good and Poor Posthospital Courses * 
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Oy" Sor group (Item 8, y? = 222; 6 Z 
are ‘i Tate of a history of previous episodes 
Ero as great in the Poor groun as in the 
tib P (Item 9, ¢ = 2.83; p < 01). The 
x clini tn of the “poor” and “fair” categories 
C mua u Prognosis at time of discharge yields 
Ome gpg t reliable separation of the two out- 


Sr 
ae Gar (Item 11: %2 = 4.36; $ < 05). 
"in leng OUP had a reliably smaller varia- 


of hospitalization than the Poor 


D Good group Poor group Total group 
atum N=58 N=119. R==177 
1. Age M=25.2 M=30.5 M=237 
spi= 94 SD= 10.0 SD= 9.6 
2. Sex 
Male 47.4% 42.8% 44.496 
Female 52.6 57.2 55.6 
3. Home 
Urban 41.39% 55.4% 50.8% 
Rural 58.7 44.6 49.2 
4. Education (N= 57) (N= 110) (N= 167) 
ess than 8 gr, 12.3% 10.0% 10.8% 
8 gr. & more 87.7 90.0 89.2 
5. Religion 
Lutheran 39.1% 33.7% 35.7% 
Other Prot, 23.9 34.9 31.0 
Catholic 34.8 22.8 27.1 
Jewish 2.2 8.6 6.2 
6. sii 
Number of sibs M= 44 M= 41 M= 42 
Ü Mars SD= 3.2 SD= 34 SD= 34 
arital status 
farried 27.1% 26.8% 26.9% 
Single > 71.2 68.0 69.1 
ivorced 0.0 2.5 1.7 
idowed 1.7 1.6 17 
Separated 0.0 1.1 0.6 
* Number of children (N=17) (N= 39) (N= 56) 
M= 2.2 M= 3.1 M= 2.8 
LT SD= 2.2 SD= 24 SD= 24 
Ype of schizophrenia 
‘atatonic 33.8% 18.4% 23.6% 
Simple a. 18.6 21.8 20.8 
Ha anoid 16.9 35.2 29.2 
jebephrenic 10.1 9.2 9.6 
Nelassified or mixed 20.6 15.4 16.8 
CTh š 7 
„ae Ns i ; i i i isons in terms of the number of 
Pat s in this a s with different item compar h 
the ie fox whom we benign ees r Where N’s are not indicated for the item, data are for 
groups, i.e, N= 5g, N = 119, respectively. 
tio i 
n š = s > 
consi. the illness prior to hospitalization was group (Item 12 a, p= 1.53; $ < 05). Final- 
in 4 crably shorter in the Good group than ly, the adjustment to hospitalization of the 


Good group was inferior to that of the Poor 
group (Item 12 b, 72 = 9.583 p < 01). It is 
of particular interest to note “Irom Item 12 of 
Table 4 that the long-term adjustment of the 
schizophrenics was not reliably reflected in 
their condition at time of discharge; nearly 
two-thirds of the patients who later made a 
good adjustment were clinically judged as un- 
improved when discnarged, while 20% of the 
patients with subsequently poor social adjust- 


\ 


A 
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Table 3 


Personal History Data for Schizophrenics 
with Good and Poor Posthospital Courses 


Good Poor Total 
Item group group 
N= N =177 
1. Interparental relat. (N = 35) (N = 101) 
Affection 82.8% 76.2% 
Ambivalence 5.7 5.9 
Indifference 0.0 1.9 
Hostility 11.4 15.8 
2. Paternal relat. (N = 41) (N = 127) 
Affection 70.7% 65.3% 
Ambivalence 9.8 5.5 
Indifference 0.0 3.1 
Rejection 9.8 11.8 
Overprotection 0.0 1.5 
Domination 9.8 11.8 
Jealousy 0.0 0.0 
Dependency 0.0 0.0 
Neglect 0.0 0.0 
8. Maternal relat. (N = 47) (N = 128) 
Affection 61.7% 64.8% 
Ambivalence 2.1 2.4 2.3 
Indifference 4.2 0.0 1.5 
Rejection 2.1 8.6 6.2 
Overprotection 12.8 13.6 13.2 
Domination 14.8 8.6 10.9 
Jealousy 0.0 0.0 0.0 
Dependency 0.0 0.0 0.0 
Neglect 2.1 0.0 0.7 

4. Sibling relat. (N = 48) (N=83) | (N= 126) 
None 4.6% 3.6% 3.9% 
Affection 76.7 75.9 76.1 
Indifference 4.6 4.8 4.7 
Rivalry 11.6 14.4 13.4 
Domination 0.0 1.2 0.7 
Submission 2.3 0.0 0.7 

5. Sibling rank (N = 34) (N = 63) (N = 97) 

9 5.8% 4.89% 5.1% 
1 26.4 28.6 27.8 
2 20.6 19.0 19.5 
a 17.6 14.2 15.4 
14.7 17.4 16.5 
4 5.8 6.3 6.1 
a 5.8 3.2 41 
8 0.0 1.6 1.0 
9 2.9 0.0 1.0 
10 0.0 0.0 0.0 
11 ty 3.2 21 

6. Home ii 1.6 1.0 
Poverty 
Alcoholism Ba” | 109% | 9.0% 
Invalid 16 sa 6.8 
Divorce 16 0.0 0.6 
Separation 34 ae ret 

eath of parent 10.2 f . 

7. School ace 2 10.9 10.7 
Marked hostility” Ore) | (N= 106) | (N= 159) 
Mild dislike oa” 2.9% 3.8% 
Indifference 24.5 12.2 11.3 
Agreeable 52.8 26.4 25.8 

N A | 28 | et 

* School achievemen es sa 4 
Repeated failure | 355) |0210) | owies) 
Work difficult ? 14.2” 3.7% 4.9% 
Av. performance 58.9 oan 19.6 
Easily earned grades} 10.7 45.8 50.2 

š Accelerated 8.9 ae 19.6 

+ School depor' = z 4.4 
Poor record pent ae (N=77) | (N= ayes 
Usual no. of we 5.2% 1.9% © 
~seapades n 21.6 
Excellent re i 52 10.6 

10. Occupation S eats 89.6 481.6 

one 22.0% | ines, | 

se Gem | dist | 2%, 
Average son 18.4% 14.9% 
Good 62.5 32.2 81.5 

12. Satisfaction (N= 40) we 53.5 
Dislike 12.5% Be.) | (N=126) 
Indifference 32.5", apn” ee? 
Enjo, ment 4 š 

55.0 43.0 46.8 


Table 3 (Continued) 


13. Social (N = 31) (N = 54) 
Withdrawal 58.1% 63.0% 
Ambivalence 148 
Membership nee 

14. Dating Cire 100) 
None or little 56.0% 
Average an 
Very popular ee 
Steady dating pe 

15. Recreation (N = 108) 
Predominantly 

solitary 38.8% 
Mixed Dte 
Social oa 

16, Church attendance (N = 98) 
Very infrequent 41.8% 
Occasionally 26.5 
Steady 317 

17. Delinquency 2.5% 

18. Criminal record 5.0% 

19. Heterosexual 

adjust. (N = 1183) 
Poor 22.1% 
Feir 34.5 

OO! 

20. Adequacy of “ast 

outlet (N= 58) | (N= 112) 
Poor 17.2% 28.6% 
Fair 32.8 294 
Good 50.0 42.0 

21. Marital ý 

one 71.2! 
a. Adjustment (N 2%) (wed) 
Extreme frustra- ~ 
tion 0.09 
Continual conflict 0.0 $ zoe” 
Compatibility 50.0 38.2 
Pleasant 43.8 14.7 
Chief pleasure 6.2 2.9 
"(N= 17) (N = 34) 
b. Affection to mate 94.1% ; 
22. Personality S hupa 
a. qereadth of interest | (N = 58) (N = 114) 
jarrow 27.1 
Some interest ia nee 
outside self 64.4 
Broad interests 8.5 "he 
b. Tavel E sanitation (N =58) | (N= 112) 
imited goals 
Interested in ae ae 
improving 56.: 

High ambition 8:8 T.S 

c. Life plan N= 54) | (N= 110) 
Confused and soia Anega 

unrealistic 

Fairly clear 25.6 oe 

d. Stability (N= 58) | (N= 114) 
Constant fluct. 16.9% 12.2% 
Moderate varia- ied 

ility 2 
Stolid, even jis se 
tempered 
e. Initiative ine 58) (Wan) 
Apathetic 13.8% 16.9% 
Appropriate 62.6 48.6 á 
nergetie 23.6 39.5 

5 Social intelligence | (N= 58) | (N= 109) 

and elu: 

Moderate skill | 9:47 | 11.9% 

dept, 3.4 3 
g. Poise N- i 

Retiring and CAEN 0P Hae) 

sensitive 
Fairly a-ticulate ae” aaa 
Confident in most i : 
Situations 

pp 11.8 13.4 

. Relivivusness = i 

argely intellec- Ns 48) | (Nera) 
thelized and rit- 
ualistie 
Occasional solace | gg:29% a” 
ominant source : g 
of balance and t 
ea i 
ce of mind 41.8 39.7 


(N =85) 
61.2% 
14.1 
24.7 
(N = 145) 
57.290 
42.8 
0.0 
35.9 


(N = 163) 
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EI n Table 4 

Elements in the Presenting Illness of Schizophrenics with Good and Poor Posthospital Courses 

Good group Poor group Total group 
hean N=58 N=119 N=177 
1. Areas of manifestation of illness 
%o %o %o % % % 
H Patients Problems | Patients Problems | Patients Problems 
ee 35.2 18.2 45.6 19.6 37.1 19.2 
Sal 20.4 10.6 26.2 11.2 21.4 4 
Occupational 25.9 13.4 35.9 15.4 28.7 14.8 
Religious 3.7 19 6.8 2.9 5.1 2.6 
Sexual 16.6 8.6 31.0 13.3 23.0 11.9 
2 Gctsonality 90.6 471 87.3 37.4 87.1 40.4 
* general health (N= 54) (N= 108) (N = 162) 
avalig 0.0% 1.99% 1.2% 
any minor illnesses 13.0 13.0 13.0 
Sual diseases 18.5 21.2 20.4 
Occasional ailment 40.7 28.7 32.7 
3, y Bood health 27.8 35.2 32.7 
4, punticaps 6.7% 2.5% 3.9% 
5. ye otmities 1.6% 1.696 1.6% 

É Drit (v=45) (N=79) (N= 124) 
p derweight 2.2% 5.19% 4.1% 
Sa iti 19.0 16.1 
B ¢ll-proportioned $2.2 67.1 72.5 

“som 0.0 6.3 41 
A Overweight ae 2.5 3.2 
Mtem involvement 
ardiorespiratory 3.39% 0.8% 1.7% 
astrointestinal a 1.6 2.5 2.2 
7 enitourinary 1.6 5.8 4.5 
ge at onset (N= 58) (N= 114) (N = 172) 
M=24.6 M = 26.4 M=25.9 
8. Develo sD= 7.0 PE E 
Over Ena of symptoms oe ( ah 50.0% 
seonth to a year 55.2 30.2 38.5 
9, $838 than a month 19.0 7.8 11.4 
10. pe vious episodes ° ” 13.6% 37.8% 31.4% 
tiology geo (N= 116) (N= 171) 
rsonality sate 99.1% 98.8% 
amily rd 11.2 10.5 
ie ia are ao 
CCUpatio . 2.6 5.2 
ibacity oe Er 43 4.0 
L Progni ss = aris) 
Bnosis ne (N=110) = 
Poor (N ae 60.9% 55.2% 
air z 36.3 41.6 
12, Qood g 2.7 3.2 
a, ps in hospital _ 
ngth (N= 57) (N=119) | (N=176) 
M = 338.6 days M = 40.4 days M = 39.9%days 
N SD = 27.6 y SD = 344 SD=301 
prdiustment ð (N= 53) (N = 108) (N= 161) 
me 5 28.2% 13.0% 18.1% 
a ` 490 426 > 44.6 
“oad ‘ 22.8 44.4 37.3 
Togress 2 (N= 56) (N= 118) (N= 174) 
Sp nange ` 62.5% 66.970 65.5% 
Dail! improv, > 10.7 16.9 149 
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Table 5 


Mental Status of Schizophrenics with Good 


Table 5 (Continued) 


: . i N=6 = 114) | (N =171) 
and Poor Posthospital Courses eS Se aia pene | di 
oo wide lability 14.0% 8.8% 10.5% 
Good Poor Total change 14.0 24.6 aa 
Item group group group Stable 72.0 66.6 68. 
Nees Neg _ N=177 oe (N= 54) | (N=112) | (N = 166) 
ation = = 112 = 
1. Delusion _ (N = 22) | (N = 44) N = 66) Depressed 55.5% 28.5% 37.3% 
Mild transitory 36.4% 31.8% 83.3% 51.2 
M fant 9:270 O o Composed 31.5 60.6 
es nsive 50.0 46.4 47.0 Happy : 13.0 10.9 ys 
LAE c, Anxiety 23.7 16.0 . 
- sS testablished 13.6 ve 19.7 d. Moodiness 3.4 3.4 3.4 
Tiiience ib "a 1.1% e. Irritability 10.2 5.0 6.8 
Nihilism 5.0 1.6 2.8 i z i = 174 
Persecution 35.6 36.1 35.9 ~~ ae i a a ee (S569 | 
Reference 15.2 27.7 28.6 Fair 40.4 o 29.9 Jo 33.3 | 
ligion 13.6 14.2 14.0 Good 18 0:9 1.1 
Self-change 1.6 3.4 2.8 12. Stream of | thought l ‘ 3) | 
; ° s 5 a. tetusal-Flight (N=58 N = 115 N21 
Unreality ro lee | Reio nek | 2o% | eog | Naame 
2. Hallucination ; l aera ct a Hr 
A 24. 20. 22. 
Auditory 35.6% | 81.0% | 32.6% Normal Tr ia ti 
Olfactory pe 26 AR Verbose 7.0 5.3 5.8 
Haptic 0.0 0.8 ve Voluble 7.0 9.6 8.6 
Gustatory 0.0 0.0 0.0 Flight of ideas 13.8 9.6 1.0 
3. Complaints— Consist -Distract. (N =61 (N = 108) | (N = 159) 
hondriacal : ‘ > 66.69 : 
4. Raela #490 ii i Rzcumstantial on n 102” ia 
Apathy 15.2% 17.6% 16.9% ambling 23.5 28.7 27.1 
D naliza : "2 To c. Coher.-Incoher, 2 = 2 
DOue es fe os a Coherent (N = 63) (N=107) | (N= 160) 
Guilt 18.6 16.0 statements | 
Inferiority 1.6 4.2 pr d. Impoverishment "ae 89.7% | 90.0% 
| Isolation 1.6 0.0 0.6 e. Echolalia 1.6 0.0 0.6 
A Perplexity 10.2 3.4 5.6 13. Attitude, manner, j Fiag 
o a Canty 6.8 7.6 7.3 Preece 
- Orientation . a. Cooperativeness (N = 57) = = 178) 
oO a. Ti s 2 S (N=116) | (N=1 
ee TS ne diz (N= 51) | (N= 110) | (= 161) rn oo 14.6% 18.5% 
j orientati ; . 32.8 29. 
A Minor AS oe” 8.5% 10.6% oo 50.8 52.6 52.0 
~ Answers well 0. om 8.1 S bport (N =54) | (N= 116) | (N = 170) 
b. Place (NS 51) SS 81.3 a oe 42.6% 33.6% 36.59% 
Gross dis- (N=111) | (N= 162) Glose ~ 42. 40.5 41.2 
° A - 92 
Bllcr oes ae” 8.6% 5.6% c. Psychomotor iii abd ii 
nswers well 80.4 Pre 4.9 ao 6.8% 2.5% 4.9% 
c. Person N= 6 89.5 S O 50.8 50.4 50.5 
Gross dis- (N =50) | (N= 111) | (w= 161) Uggestibility 1.6 0.8 1.1 
orientation 8.09% R Faceti 0.0 0.8 0.6 
Minor errors 40 Fia e59 uer onune 6.4 0.8 I 
nswers well 88. 3.6 3.7 ulousnesg a0. 2.5 1.7 
6. Memory 0 91.9 90.7 ostility 16.9 E8 9.6 | 
ai Pane — d Aptultiveness 11.8 8.4 9.6 
ague Et (N = 107) | (N = 153) Dike (N=49) | (N= 103) | (N= 152) | 
Minor ae ae” 4.1% 5.2% beth gs 30.6% 26.2% 27.690  ; 
ccurate 3 . 8.5 24. : 6 
b. Recent events AG 46) 86.0 86.3 ‘ Ma groomed 44.8 16 44T 4) 
Vague 15.3% (N = 101) (N = 147) . ai irand (N = 49) (N = 45) (N = 9 
Mor errorg 9.0% 10.9% : ure 6.9% 0 2.1% 
Accurate ÉLT 12.8 15.6 inor anach- 0 0% 
©; Recent verbal Ne ony | (io 72.5 Sheen 0.0 2.2 1.3 
Sa etam | era | Nom) e pienet mature | ogg | 22 | oth 
a 18.5 ; “U'70 ; ; 
ceurate 9.1 12.5 anic A9 
d. 4 55.6 68. 5.0% 2.5% 3.37 
Vent numerica] | (N= 36 (N60 Ro e 22.0 8.4 i 12.9 
Minor erro 16.6% 11.7% Ne 105) Blushin 5.0 3.4 8.9 
peccurate iz eee 27.5 ar e% Tea F ge 0.0 
. etrospe x 60.8 x Man 3 , 1.6 y 
falsification’ ,| S=9 | aaa we yperkiness 128 18.4 Le 
8. Think "| 440% | 28, = 30) sis 13.6 11.8 12.4 
s nking capacity (N=42) | ( 5% 33.3% i Catalepsy ios 8.5 
Below averag 9.5% 9.29, } (N= 140) ‘ree E t - (35) 
e ; +9; . cént. és 
Above a 47.6 ee 4 | 364” Disharmony sae) | (Ne gay [vet 
: average 7.9 : 43.5 Dpropriate 
High : 9.2 dis ] , : ; 
9.General information ne a í pi ae Mil H aie) ai en re 43.0% 451% 
peio avrngs | e% | eap [tay omma | AS | aR | dea 
Average B19 ae 28.3 c Insoninia An 4.2 Ai 
Abova average 14.6 * re 45.6 “g YPersensitive TE 7.6 1.6 
gh 5.0 3°9 14.2 = rigidity rie F 3.9 
ay ee Obras 3.4 0:0 Li 


a 


, 


(x = { 


Prognostic Factors in Schizophrenia 


Fable 5 (Continued) 


g. Stereotypy 
h. itigious 
l. Jealousy 
i, Fatigue 
- Vreamy states 
l: Night terrors 
me Compulsions 
a “gocentric 
. Temper tantrum 
x Amorality 
* Legression 
r. Exhibition 
8. Audecision 
utism 
15. por behavior 
siy oP riate 
Suicidal 
Stubborn 
illogica] 
SDicious 
MDulsive 
Childish 
ffected 
emorsefy] 


Self. 
Tearful OTY 
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Psychiatri considered to have made marked 


Tan m + eae 
the faite different items pertaining to 
Schiz ET aak and symptomatology of the 
nly six lean are reported in Table 5. 
requencies À - items show reliably different 
reference e le two outcome groups. Ideas 
tem 6) occurred in a reliably 


Proportion of — 
0; 5< the Poor group (¢ 


ly three ad The Good group showed near- 


orientation (1 the incidence of gross time dis- 
Cor group os 15) eas was found in the 
S emotional : =7.68; p < .05). With respect 
as muc ies one (Item 20), the Good group 
eresse nore frequently described as dull or 
“OMposed nd much less frequently described as 
2 hi compared with the Poor group 
Was reliab] 7; p < .01). Tension (Item 23f) 
(t= 35. more frequent in the Good group 
ite Practic = -05.). Stereotypy (Item 24g) 
Noted in Tally absent in the Poor group, but 
*ospital , ao of the patients with good post- 
inally “Wustments (¢ = 3.054; p < -01). 
three ti tearfulness (Item 25b) was over 
Phrenics v as frequent among those schizo- 
"hose ‘th. ith good adjustments as it was in 
Gite age = 240; p < 20). 

n all aain should be paid to the failure 
‘atu ite this very limited number of mental 
ticular. S to distinguish the two groups. In 
BEICS of aa is made of the fact that the 
$ usional involvement was not dif- 
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ferentially distributed in the two groups, that 
feelings of apathy had essentially equal inci- 
dence, and that appropriate display of affect 
characterized nearly half of each subgroup. It 
is equally notable that persecutory, religious, 
and somatic delusions; degree of insight; and 
inappropriate, stubborn, and suspicious behav- 
‘or do not distinguish the two groups from one 
another. Of much interest, also, is the very 
low incidence in both groups of symptoms 
which are commonly considered to be classical- 
ly descriptive of schizophrenia. For example, 
in the total sample of 177 schizophrenics, there 
was a less than 5% occurrence of nihilistic de- 
lusions and delusions of self-change and un- 
reality; olfactory, haptic, and gustatory hallu- 
cinations ; echolalia; stupor, suggestibility, and 
mimicry; and temper tantrums, exhibitionism, 


and autism. 

A prognostic scale was devised consisting of 
eight items selected as the most discriminating 
of the seventeen items reviewed above. The 


eight items, each of which was given an un- 


weighted unit score } 
of poor prognosis, were as follows: 


1. School deportment: “excellent record; avoided 


all trouble.” 

2. Marital adjustment: 
tion and emotional turmoil,” or 
bickering and conflict.” 

3. Time taken for symptoms to develop: over a 
year or more. 

4, Presence of previous episodes. 

5, Adjustment to hospital: “good; cooperated, 
showed initiative, carried out assignments well.” 


“source of extreme frustra- 
“continued mild 


6. Presence of ideas of reference. 
7. Orientation for time: “answers well within the 
limits of approximation afforded by sources of in- 


formation.” 
$. Emotional tone: “complacent or composed.” 


Application of this scale to the 177 patients 
included in the study, using a cutting score of . 
three or more points to identify the cases with 
poor <djustment, resulted in identification of 
59% of the cases in the Good group and 82% 
of the cases in the Poor group. These figures 
should be evaluated against the actual 29% 
occurrence of good outcomes and the 58% in- 
cidence of poor outcomes. The degree of im- 
provement over a chance prediction indicated 
by these figures does not constitute adequate _ 


‘1 a direction predictive ~ 


A 


\ 


í 


is 
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Table 6 


Means and Standard Deviations for the 8-Point 
Prognostic Scale Applied to Three Different 
Outcome Groups 


Posthospital Adjustment N M o 
Groups A and B 58 2.11 1.24 
Group C 26 2.68 1.05 
Groups D and E 119 3.68 1.58 

Total 203 3.12 1.60 


validation of the prognostic scale, however, 
since the figures represent application of the 
scale to the same group of subjects on which 
it was developed. Table 6 gives data on the 
distribution of the prognosis scale scores in the 
three outcome groups for subjects whose his- 
tories permitted scoring of the eight factors. 
The statistics of the intermediate group 
(Group C), which was not used in develop- 
ment of the prognosis scale, satisfy the logical 
requirements which pertain if there is a reli- 
able, positive relationship between the prog- 
X nosis scale scores and the criterion of actual 
WP Sra adjustment ; i.e., the mean score 
is intermediate to that of the two extreme 
groups, and the standard deviati 
that of either 
B, D and E) which constitu 
of the criterion continuum. 


Attention js 


tients involved 
Justify. While 
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Discussion 


The findings of this study may be compared 
with the conclusions reached by Chase and Sil- 
verman [3] as a result of a partial survey of 
the literature on prognosis in schizophrenia 
through 1940. They found short duration of 
illness, acuteness of onset, presence of confus- 
ion in the early symptomatology, and manic- 
depressive symptoms to be indicative of good 
prognosis. The findings of the present research 
are in agreement on these points. Duration of 
illness in our data is reflected in the relative 
discrepancies between the ages at onset and 
ages at hospitalization in the groups with good 
and with poor outcomes respectively. The on- 
set-hospitalization interval averages .6 years 1n 


the Good group and 4.1 years in the Poor 


group. Acuteness of onset is reflected in the 
“rate of development” variable (Table 4) and 


tion for time, which 
Was more common in the Good group, an 
manic-depressive Symptomatology is suggeste 
by the greater occurrence of depression an 
tearfulness in the Good group. 

Chase and Silverman indicate as also prog 
nostically significant, but less differentiating 
than the above factors, the fact of previous 
episodes, adequate Prepsychotic life adjust- 
ment, and Progressive „hospital course. The 
findings of this Study are directly opposite O” 
these Points. Thus, occurrence of previous 
episodes appears as More characteristic of he 
Poor group; most of the variables pertaining 
to previous adjustment (vide Table 3, Item 
10, 11, 12, 13, 14, 15, 16, 17, 18, and 19) 
do not discriminate the Good from the Poot 
group, and course in the hospital (Item 12c) 
showed no reliable differences between the tw? 


It 
educatio 


Thé present research ias considered a aut 
ber of factors not generally covered in pre” 
Ous investigations, There js a set of facto" 
relatively social ij: nature, or at least reflect” 
of interpersonal relationships, which differe” 


Prognostic Factors in Schizophrenic 


tia 

on he outcome groups. In brief, the 
eportment, wea charnecerized by poor school 
marital adan y church attendance, good 
mates, Genen gia. and affection toward 
ting the Sone intelligence as evaluated du- 
Marked difere status examination revealed no 
ence the dife between the two groups, and 
Pears Wer stad an in school deportment ap- 

What seems ar ¢ difference in ability. 
inconsistency i ae glance to be a strange 
TOUD to the = et adjustment of the Good 
responsible Eri highly organized institutions 
ormity, namely At devi ne pet of social con- 
he e school and the church, is 
tor active part e for by the relative demand 
individua] articipation by the individual as an 
Which wo il he seclusiveness and shyness 
<choolroom d handicap the schizophrenic in the 
y irene li be no detriment to his large- 
Course tole in church. This explanation, 
ality Eales typical prepsychotic per- 
at basis, ie and is open to argument on 
at in the en further weakened by the fact 
; ated on th ois “social withdrawal,” 
T differential f asis of case histories, revealed 
ik act of n aey in the two groups! 
maal z A association between good 
nod and good nt with affection toward the 
asonable posthospital course, seems most 


Son, 


wt ma , 
a ia a Aloi out that the poorer hos- 
tended oute of the members of the group 
of a OSY tow ome is probably related to their 
thes ard briefer hospitalization, both 


e 

ance: acto á k 

Sir 1n the ts suggesting more acute disturb- 

Hie Usual ood group; this would be in line 
fa Prognostic thinking and with the 


G requ b 
ie erous E of the catatonic type in the 
d that the © some extent it may be as- 
n, and ti Sreater incidence of stereotypy; 
Wi, 800d ime disorientation in the group 
vith Posthosp} : i: 5 
E gre Pital adjustment is associated 
; Seater incidence of the catatonic 


of De in t 
. at . o 
reviou, S Broup. Similarly, the occurrence 


e” Nhe ades and ideas of reference as 
type ; € slig ee of the Poor gioup may re- 
alleg” this Pig scales of the paranoid 
Yhes that the A However, it should be re- 
Rron, @S not over-all distribution of the sub- 
5 different for the two outcome 


and ¢ 
he Prognostic factors that have 
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been reviewed in detail may not be considered 
to simply stem from subtype variation. 

The validity of the findings of this study 
rests heavily on the thoroughness and accuracy 
of the case histories, which are functions of the 
skill and care with which they were compiled 
by the medical, psychological, and social work 
personnel, It is perhaps unfortunate that these 
were routine and not “research” histories and 
that they were not recorded with the guidance 
of the schedule of items subsequently applied 
to their analysis. However, the essential casual- 
ness of the history taking, in addition to the 
fact that items were rated only when the data 
were considered adequate, may introduce a 
type of clinical validity and permit a general- 
ization of our prognostic factors that might 
not be the case if the original history data 
were more “scientific.” Quite positively, it is 
believed that the nature and extent of the fol- 
low-up study have provided more accurate and 
socially pertinent criteria of posthospital ad- 
justment than have previously been applied in 
studies of prognosis. 

The paucity of careful follow-up studies in- 
volving reasonably large samples, extended 
postdischarge intervals, and direct evaluation 
of subsequent adjustments of patients may ac- 
count for the generally pessimistic orientation 
which is held with respect to prognosis in 
schizophrenia. This pessimism is reflected in 
the clinical prognoses which were assigned to 
the patients in this study and appears to have 
been unjustified in view of their subsequent 
social adjustments. It is hoped that data of the 
type presented in this paper may contribute to 
greater exactness in prognosis, not only by indi- 
cating the actual frequency of favorable and 
unfavorable long-term outcomes, but also by 
suggesting historical and clinical factors which 
carry prognostic import. Certainly, good in- 
formation as to basic rates of remission in the 
absence of special therapeutic efforts is essen- 
tial to any reasonable test of the efficacy of par- 
ticular “therapies, such as insulin coma. In es- 
tablishing control and experimental groups for 
testing therapeutic efficacy, attention must be 
given to adequate matching on variables, af- 
fecting basic prognosis. As an example of this, 
discrepancies in the remission rates reported 
for samples of schizophrenics similarly treated 


7X 
z ip group). 


Ad 


166 


might be explained in some instances by 
marked dissimilarity of the samples with re- 
spect to diagnostic subtype composition, if 
these data were reported by the investigators. 


Summary and Conclusions 


In 1949, a graduate social worker with spe- 
cial research training and experience attempted 
to establish direct contact with all patients hos- 
pitalized on the psychiatric service of the Uni- 
versity of Minnesota Hospitals between 1938- 
1944, an interval when no use was made of 
insulin or electroshock therapy. Of the original 
sample of 240 schizophrenics, follow-up data 
were obtained on 210 patients. These were 
rated on a five-step scale for their over-all post- 
hospital social adjustment. Twenty-eight per 
cent of this sample were found to have had no 
further difficulty or were found to be making 
a good adjustment (Good group), and 60% 
were found to have spent over half of the post- 
University interval in a mental institution or 
had experienced difficulty which necessitated 
continuous care by their families (Poor 


The Good and the Poor outcome groups 
were rated and contrasted with respect to 200 
items pertaining to their 
vious Personality, and pre 
17 of the 200 items di 
groups at the 5% 
number of positive 


ations represented by the two 
, the smallness of the num- 


W. Schofield, S. R. Hathaway, D. W. Hastings, and D. M. Bell 


the quality of his adjustment are highly elus- 
ive, and their detection would require a much 
more intensive clinical evaluation of the post- 
hospital course than has as yet been achieved. 
The other possibility suggested by the Snina 
of this study would be that subsequent oe 
adjustment of the schizophrenic is determine 
by factors of a largely endogenous nature that 
are inherent in the disease process. t 


i cay e 

With respect to prognostic indicators, a 

patients with good posthospital scien 
were differentiated from those with poor a 


: ion 
justments by the factors of: shorter duratio! 


of illness prior to hospitalization; more rap! 
development of symptomatology; absence 0f 
Previous episodes; poor school deportmenti 
steady church attendance; good marital adjust’ 
ment and affection toward the mate; stereo” 
typy; tension; depression; tearfulness; disori 


entation for time; and absence of ideas of re! 
erence. 
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The diff, r 
era prognosis of paranoid and 
Chiatric levers ner hras a long history in psy- 
ased on theve di [2]. However, predictions 
Roc a ap k 
© improve ogre some instances, paranoids 
het the epressed patients do not [5, 
“nreliable į current classificatory system is 
a k oe conceded [2, pp. 86-87], 
which ae variables which are reliable 
tha’ of treatme Prognostic value for the out- 
€ classical di nt is clear. Taking its cue from 
an epressi ifferentiation between paranoid 
@ Albee Üj; disorders [3] and from studies 
Onsiderg dire ad Smith [9], the present study 
mental Ae of aggression as a parameter 
i Part of a ns and its relation to prognosis. 
5 Udy also ate arger research project [6], this 
Veaknesses Be i to avoid one of the major 
3S far as carlier prognostic studies in that, 
Prognostic Possible, otħep variables of known 
ection oF Snificance are held constant while 
aggression is studied. 


and 


Method and Procedure 


Preyj 
Mek aper described the selection ofa 
Patients from the population of 
in patients at the Western 
males ie and Clinic [6]. There 
ic cate oe 257 females in the sample. 
win ce were represented as fol- 
With SYchoses 17 izophrenia, 58 with affec- 
Oy, de ¥choneur, with “other psychoses,” 95 
Unione tatus oe and 52 with behavior dis- 
tion Proved 9 categorized as improved or 
one yeap Gerding to follow-up informa- 
an a ter discharge. There were 234 
*liah: Practica] 52 unimproved individuals. 
lity g : effort was made to insure the 
the “improved-unimproved” di- 
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chotomy, and evidence was presented to indi- 
cate the validity of the judgments [6]. The 
sample contained no subjects younger than 15 
or older than 55 years and no known cases of 
cortical damage or mental deficiency. No pa- 
tients had a serious somatic illness, and none 
had a history of recovery from previous alien- 
ations. 

Guided by the literature and the feasibility 
of obtaining reasonably reliable measurements, 
we selected 21 variables and related them, by ap- 
propriate statistical techniques, to status one 
year after discharge from the hospital. Of 
these 21 variables, the following 9 were found 
to be significantly related to the defined out- 
come of treatment: affective expression, orien- 
tation, diagnosis, onset, duration of illness, pre- 
cipitating stress, type of treatment, marital 
status, and direction of aggression.. The inter- 
correlations of these variables were also inves- 
tigated. Then an attempt was made to hold 
eight of the relevant variables constant while 
investigating the relationship between status 
and the ninth variable, direction of aggression. 
In other words, the group of improved and un- 
improved patients were of the same size, con- 
tained the same number of diagnostic categor- 
ies, and had no statistically significant differ- 
ences between their means on length of illness, 
type of onset, stress, and so on. Such matching, 
which was deemed best for greater precision, re- 
duced the original sample vf 486 to a con- 
trolled\sample of 100 improved and 100 un- 
improved subjects. 

Direction of aggression was measured by @ 
nine-point rating scale, details of which are 
described elsewhere [4]. It was found to have 
a reliability coefficient of .83 when two clinical 
psychologists independently rated 40 case is- 


ANN 
AP} 
T 


Gd 


ratings and status. one 
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tories selected at random from the hospital files. 
The nine points along the continuum from ex- 
tremely extrapunitive to extremely intropuni- 
tive behavior are presented below. 


Point one: homicidal attack. The use or threat- 
ened use of lethal weapons, Attempts to strangle or 
maim. Blame projected onto others in conjunction 
with this behavior. 

Point two: combative behavior. Assaultive, ex- 
tremely destructive, while projecting blame. This 
point may include a previous suicidal attempt which 
was obviously aggressive in nature, followed by as- 
saultive behavior. 

Point three: verbal abusiveness, or systematized 


Paranoid delusions expressed with or without verbal 
abuse. 


Point four: blame Projected onto physical com- 
plaints, as long as the hypochondriasis is not bizarre 
or depersonalized. Vague, unsystematized projec- 
tion. Ambivalent behavior, with occasional aggres- 
sive activity toward others. 


Point five: ambivalent, impunitive. This point in- 
cludes obsessive-compulsive behavior and incoherent 
states, 

Point six: mild depression. 
with some evidence of de 
occasional tears, Bizarre 

Point seven: depress 
blame expressed, with 


Ambivalent behavior 
Pression, as in apathy with 
hypochondriacal complaints, 
ed. Feelings of guilt, self- 
no projection of blame. 


Point nine: serio 


us suicidal attempts a 
self-condemnation, sida 


‘xtreme 


the hospital (see Table 1), Tha harge on 


ho receive 


Dorothy A. Feldman, G. R. Pascal, and C. H. Swensen 


Table 1 


Summary Statistics for Total Group and 
Controlled Sample Group 


Controlled 

Statistic Total group sample group 
N 486 200 
Meant 
Improved 5.02 4.20 
Unimproved 3.16 3.69 
Standard deviation 
Improved 1.72 1.28 
Unimproved .95 133 
t 14.31% 2.83" 
Toist .67* 23 


* Significant at .01 level. 
7 In rating scale Doints, 
+ Between direction of aggression and outcome. 


Table 2 


Relationship between Direction of 
Aggression and Significant Variables 


(N = 486) | 

Variable Statistic aon 
Affective expression 2 a 
Orientation oF 

Diagnosis i a | 

Type of onset o 
Duration of illness wi 
Precipitating stress = 
Treatment = 

Marital status sould 


tended to have had less precipitating a 
less affective display, à longer period of illnt 
an insidious type of onset, and to be unmarrie | 
disoriented, and to carry a diagnosis of sci? 
phrenia. The diagnostic categories for thoe jc’ | 
the high ranges of the scale tended to be ae 
depressive and involutional psychoses, an at | 
active depressions. Those earning middle “A 
Ings were most often diagnosed as having id 
fective Psychoses or psychoneuroses. The ™ re 
dle and high groups on the scale showed on ' 
affect, gseater stress, more pronounced pow: 
very little disorientation, and shorter durat! 
of illness, of 
Table 3 Presents a summary of the results 5 
matching the improved and unimproved gre he 
on eight of the significant variables, while he 
aggression variable was left free to vary: fot? 
biscrial Coefficient of correlation was .67 be 0 
matching, and .23 when other relevant face | 
were held constant, as is shown in Table 1- 


è 


Direction of Aggression as a Predictive Variable 


> Table 3 


Di 7 
ifferences between Significant Variables 
Controlled Sample Group 


in the 


Im- Unim- 
Vane im. 
ariable proved proved Statistic $ 
Affective 
expression 
ean rating 5.38 5.26 I= AS >05 
Orientation 
Oriented (N) 91 s 
Disoriented (N) 9 ià x2=1.23 >.05 
Type of onset 
ean rating 
5.11 5. — Fi 
Duration om t 77 >.05 
„can, 
in m 
Pret 324 28.6 tHE >05 
Ccipitating 
Stress 
ean ratin 
g 3.03 — g 
De of 2.90 t= 52 >.05 
treatment 
on- 
Physica] (N) 30 - 
5 
Physical (N) 7 a ym 57 S05 
arita] Status 
ngle (N) 56 
arried (N 55 
ivorceq ? o 34 x2 = 5.23 >.05 
Š 11 
reas N) 
‘Zophrenia 45 
€ctive 4h 
o choses m 
th 11 
a Psychoses 5 5 N 
Choneuroses P one 
p der 5 25 
ON Psych 
oses 44 
14 
Means 


for t ` 
Were 4 he improved and unimproved groups 


ely, a 1.28) and 3.69 (SD, 1.33), re- 
“nce is still a £ of 2.83, Although this dif- 
ot confid significant at the 1 ‘per cent 
Sgr ‘Ictive ae it represents quite a loss in 
mets fel oe However, the retention of a 
tiall. ter th ationship to outcome of treat- 

ing em lo rather stringent method of par- 
ncy „p OYed here indicates the probable 


irecti 3 
Mable, ection of aggression as* a prog- 
X 3 
~ Method 
lons, T 


Dreq F 


fy 
n 
ct used here appears to serve two 


e first is concerned with tech- 


169 


niques of studying a single, well-defined vari- 
able while controlling the concomitant influ- 
ence of related factors. The second function is 
that of suggesting the type of objective meas- 
urement which may facilitate comparisons of 
many studies. A single example may illustrate 
this point. Paster and Holtzman [7] reported 
a good prognosis for “paranoids and cataton- 
ics,” results which at first seem to contradict 
the present findings. However, careful reading 
reveals essential agreement. Their improved 
group consisted of “paranoid schizophrenics 
who were dull and apathetic” or “manic-depres- 
sives with paranoid trends” and “catatonic 
schizophrenics who were not difficult to man- 
age.” It is obvious that one cannot fit all para- 
noid reactions into one paradigm or all de- 
pressive behavior into another. The use of a 
scale for rating direction of behavior may help 
to reduce the many differences in criteria 


which Bellak deplores [2]. 


Summary 
A group of 486 patients hospitalized for 
“nonorganic” mental illnesses were categorized. 


as improved and unimproved one year after 


discharge from the hospital. Twenty-one vari- 
history material, 


ables, extracted from the case 
were studied for their relationship with follow- 
up status. Nine pertinent variables were found 
to be significantly related to outcome of treat- 
ment. One of these, direction of aggression, a 
rated variable, was found to have a significant 
relationship with follow-up status when the ef- 
fects of the other significant variables were par- 
tialled out. It was concluded that direction of 
aggression, as defined, was a reliable prognostic 
variable. The patients who tended to direct 
blame or hostility exclusively onto the environ- 
ment appeared to have a poorer prognosis for 


status one year after discharge from a mental 


hospital. 
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Pr Fete gt 
i lone factors or precipitating stress 
ing Prognostic orted in the literature as hav- 
Consensus js i value in mental illness. The 
tating facto that the presence of some precipi- 
nature, BER especially one of a fairly severe 
tally in] es for a better prognosis in men- 
Precipitating fee than does the absence of a 
tecipitatine actor. The rationale for using 
at ee sie as a prognostic indicator is 
Precipitatin = © succumb only to fairly severe 
resistance T actors have a greater stamina or 
© become oe life stress than do those 
Stress, Thi ill with little or no precipitating 
'mplies th S greater resistance to severe stress 
from the at, when such patients are removed 
tion, ¢ ey ete situation, as in hospitaliza- 
3 symptoms ct a better chance for a remission 
"sistance — would be true if they had less 
E an . ress, 
Ing ine niies have been made of precipitat- 
be extensive | a preceding article [6] contains 
s Summari, bibliography. These studies can 
Most of 4 ized very briefly by stating that 
p Pitating em agree that the presence of pre- 
be er po Stress is generally indicative of a 
In Prognosis tha h ae 
Stress, In an the absence of precipitat 
Yor t° Sate studies little attention 1S 
Ste, TePorti ical treatment of the data be- 
dieg whi ae percentages. In none of the 
of es en dealt with multiple prognostic 
the 2° significa. attempt made to study one 
the Others, That variables while controlling 
basis ar ese latter two considerations are 
the present research. + 


Seq 
e upo . 
hog??? 4 dissertation submitted to the Grad- 


ol 

of the University of Pittsburgh by the 
partial fulfillment of the require- 
-D. degree. 
i ersity of Pittsburgh when this re- 
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Procedure 


The case records used in this study were 
those of the Western Psychiatric Institute and 
Clinic (WPIC), University of Pittsburgh. 
The records of all patients admitted to this 
hospital since November 1942 and dis- 
charged not later than July 1950 (to allow 
a minimum of one-year follow-up) were ex- 
amined. There were 1,118 admissions and dis- 
ween these dates. The following 
criteria were then applied to these records for 
selective purposes: age 15 to 55, lack of known a 
cortical damage, absence of mental deficiency, 
absence of incapacitating somatic illness, and 
absence of previous attacks of mental illness. 
The last criterion requires further explanation. 
Since WPIC is primarily a referring hospital, 
most of its patients come from other hospitals. 
Therefore, the criterion “absence of previous 
mental illness” means that upon admission to 
WPIC the patient was suffering from one con- 
tinuous attack of mental illness without known 
prior attacks which resulted in referral to a 
psychiatrist. Application of these criteria left 
486 cases available for further study. 


charges bet 


Status one year after discharge was cate- 
gorized as “improved” or “unimproved.” A 
patient was considered improved if, one year 
after discharge from the WPIC, he was work- 
ing at a level of efficiency roughly equivalent 
to that which obtained prior to illness. He'was 
considered unimproved if, one year after dis- 
charge from the hospital, he was in another 
mental hospital, or was manifesting other be- 
havior which, when judged by comparison with 
expectations about a person of like status, was 
indicative of inability to cope with his e>yiron- 


ment. v 
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cipitati tress. 
i ively severe precipitating s 
i r Point 7. Relative i ; "i 
erone ee “anit A This category of the scale includes a 
i ANANS i eyere than the avera 
study in the sample of 486 cases. bi re- environmental stress more sev = na e Paa 
were: sex, age at admission, marital s a j a person may ever ie lees aE aa E vary i 
ligion, nationality, occupation, CCONORIIG IERCH Shien [oss of threatened loss o son sry Be 
body type, education intelligence, affective ex- portant to the individual’s security. It is ex asa 
reais i ion, di i f ession, by the threatened loss of a loved one throug $ 
pression, orientation, direction o ager , y illness or injury, rejection by a loved one, or l 
ean peers e clr ere bs of livello alter a period of good gee 
i i italiza- ; oci ci 
z oes tention longa: total Hosp tress will also frequently include a gti Brie» 
tion, status on discharge, precipitating s ¢ or moderate stresses occurring together ar ae 
and treatment. A more complete treatment o ing in the equivalent of severe precipitating ' 
the measurement of each of these variables and 


Point 9. Extraordinary, extreme precipitating 
their relationship to outcome of illness WaS re- stress, i 
ported by Pascal eż al. [6]. However, singe This category includes precipitating factors 
precipitating stress is the special Province of 


E š fa 
p extreme as to be overwhelming, such as a 
this paper, it will be dealt with here in detail. child or children, or of a spouse where the rela 
s > 


. It 

ship has been a very close and dependent et a 

Rating of Precipitating Stress would also include the complete peut ore e 

A nine-point scale was constructed for rat- oF dated life pattern through some catas 
nine- 


fect 

tie A or disaster strikin suddenly, or the same ale 

ing precipitating stress. Point 1 on ‘the scale caused bya aoid S caer morang environ 

represented little or no stress, and point 9 rep- mental stresses following a long period of 
resented severe stress. A condensation of the adjustment. In any event, a case history ma | 
final scale used to rate the cases is given below. Point 9 would be the net result of a far = per- 
The full scale may be found in Cole’s disser- amount of precipitating stress than the averag 
tation [3]. son would ever experience, m 

Point 1. Little or no precipitating stress, It will be noted tht only five points (poin 
bS Included here are those cases in whi 


ii ed. 
ch no precipi- 1, 3, 5, 7, and 9 on the scale were defin 
tating factor was found, Many of these will haye A ) ‘ 
case histories of a life! 


k . an 
time of stress and poor ad- The even-numbered points faints 2, hir the 
period of relatively stable ad- 8) were used as intermediate ey ee 

ment may have been rating of cases that appeared to fall be 


al illness precipitated the defined points on the scale. 
often temporary, kind of stress 


illus- 
ty person frequently enicdittiters After the scale Points were defined paces 
ily, trated, forty cases were. selected and nage 
-+ dently rated by two clinical psychologists cale 
Which are admitted- amount of precipitating stress, using hao ' 
e that hee may be regarded as just described. Their ratings ae 
most people, the re, Indicating fairly good reliability. 


d 
state -bles at 
i The relationship between the variabl 
Porary in nature, 


a a 
. tive 

i ili : outcome. Eleven of the variables (affective, n 

ao ai itary servi g single man, death 

of a parent when i 


o! 

. : . * e ress! 

: $ pression, orientation, direction of agg ital 

of a pa » birth of a child, Pression ion, hosp 

illness in the fam illness or diagnosis, type of onset, ee tl 

minor injury to the Patient, Stay, marital Status, status on score fica t 
em 5. Moderate precipitating stress, Cipitating stress, and treatment) are oad level 
nel uded under i re such Precipitating ly related to outcome of illness at the - ch 

ton into milita; i 


eí 
0 

ee a man or be i reatment «gus 
ly responsibilities, heavy financial „r lictten A more complete tres Ho 


Included he 


A 5 rev! 
of i i ed in a P 

| injury to the patieee these variables is contain 
Marital adjustment, Worry about q Paper [6]. 


z ar" 
SE” tv 
; Method used to control the significant, the 
ons of two or 


e 
ables, i is study lies 1", p 
usually occurring 7/8: The crucial part of this s o! 


M ulatte, 
time so that they SElertion of the controlled sample pop", if 
rate precipitating and in the c 


Z slg! 
ontrolling of all vamabes S Je 
2 
cantly related to outcome except the 


stress. 
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ne stress. Precipitating stress was 
were then ja i ary, and appropriate statistics 
able alone ie bed determine whether this vari- 
anp dn ee 
Sine atter d ischarge. 
States aa criterion „used throughout was 
improved hi ar after discharge, categorized as 
divided a unimproved, the +86 cases were 
an animi = improved group of 232 and 
groups hee & group of 254. These two 
found to be then matched for the variables 
other than e Na my related to outcome, 
Cases until a stress, by eliminating 
in means Eitua ere no significant differences 
Proved grou api the improved and unim- 
Variables, The With respect to each of these 
and tone = controls reduced the improved 
Merences ae groups to 90 cases each. The 
nificant y; between the final groups on the sig- 
variables are contained in Table 1. 


Table 1 


ignifie 

an . 

ample Ge Differences between the Controlled 
3roups on the Controlled Variables 


Vari 
ak riable Statistic p value 
tective e r 
Grientation on = a ze 
ecti ee ne 
Type aa rd aggression 1= .00 >.05 
set 
urati ins 
Total ke of illness z 03 
spi : 
Treatment mey a 
Diagnos s >.05 
arit >.05 


al r 
o ee 


As 

sample further check, the final controlled 
the othe oa were compared with respect to 
level of c ten variables not found to meet the 
foung de tence of .01 decided upon. It was 
not di at the controlled sample groups di 
these Eia Significantly in means for any of 
Snsignificant variables. 


When Results and Discussion 
finally the controlled sample groups were 
fey are Eohied on the significant variables, 
ne s re © Compared with respect to peecipitat- 
oy i which was the only factor loft free 
` it was found that there were no sta- 
of e Significant differences between the 
tecipitar unimproved groups in amounts 
ating stress. Table 2 shows the dif- 
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Table 2 
Summary Statistics for the Total Group 
and the Controlled Sample Group 
Statistic ‘Total Controlled 
group sample group 
N 486 180 
Mean* 
Improved 3.23 2.92 
Unimproved 2.51 3.01 
Standard deviation 
Improved 1.91 1.60 
Unimproved 1.60 1.81 
tt 4.43§ ao 
PR .25§ =.04 


* In rating scale points. 

+ Between improved and unimproved groups. 

$ Between stress and outcome. 

§ Significant at .01 level. 
ferences between the controlled sample groups 
in precipitating stress. A ¢ of .35 was ob- 
tained, which is not statistically significant. 
These results were strikingly different from 
those obtained in the original total sample 
population of 486 cases, where precipitating 
stress was found to be related to status one 
year after discharge at the .01 level of confi- 
dence. It will be noted that the mean ratin 
for the total improved group was 3.23, an 
for the unimproved group, 2.51. However, in 
the controlled sample groups, the mean rating 
for the improved group was 2.92, and for the 
unimproved group it was 3.01. The difference 
between the total groups was significant, but 
the difference between the controlled groups 
“was not. The average amount of precipitating 
stress for this particular sample of hospitalized 
patients fell at point 3 on the scale. Point 3 
includes what might best be described as or- 
dinary life stress: those situations which ad- 
mittedly are somewhat stressful, but which oc- 
cur so commonly and are withstood by such a 


Table 3 


Relationship of Precipitating Stress 
to Other Significant Variables 


Variable Statistic p vaiue 
Affect.ve expression 01 
Orientation 05 
Direction of aggression 01 
Diagnosis s .02 
Type of onset «05 
Duration of illness - .01 
Treatment v.50 

01 


Marital status 


174 


large proportion of the population that on this 
scale they were rated as mild. 

To show the difference between the total 
sample and the controlled sample groups with 
respect to the prognostic yalue of the variable, 
precipitating stress, Table 3 is included, show- 
ing the relationships between the eight signifi- 
cant variables and precipitating stress. An ex- 
amination of these relationships reveals that 
precipitating stress is significantly related, with 
a probability value of .01, to the following 
four variables: affective expression, marital 
status, direction of aggression, and duration of 
illness. Relationships approaching. significance 
(less than .05 but greater than .01) are found 
with orientation, diagnosis, and type of onset, 
It would appear from these results that pre- 
cipitating stress is not a pure variable, but ra- 
ther, that it depends for what prognostic 
value it has on its relationships to other signifi- 

cant variables. 

Most of the significance found between 
amount of affective expression and precipitat- 
ing stress derived from the upper end of the 
recipitating stress scale, That is, patients hay- 

ing more than ordinary life stress as a precip- 
Itating factor tended to be rated high on affect. 
hose patients with very little Precipitating 


Stress varied in the amount of affective expres- 
sion, 


s than did married ones. 
pee married people broke down 
re to e ipitati: 

Sen dia eae cay "om Sontag stress 
might be interpreted in the ligh 
tional personal 

that go with marriage, 


Opportunities for stressf 


jected outward towar 


was also significantly re- 
which perhaps, in turn, 
tu statistical significance 


lated «o diagnosis, 
gives the apprəach 
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found between precipitating stress and diag- 
nosis. ; N 

As might be expected, duration of illness 
was found to be significantly related to pre- 
cipitating stress. In those cases of very long 
duration, little or no precipitating sires Wa 
found, and where the illness was of relatively 
brief duration, greater amounts of precipitat- 
ing stress were found. 


Summary 
Using predetermined criteria, 486 case rec 
ords were selected from the files of the weg 
ern Psychiatric Institute and Clinic. Thes 
records comprised all cases admitted up to Ju 7 | 
1950 which met certain criteria. All we 
records of patients between the ages of 15 W 
55 who were without mental deficiency, wit J 
out known damage to the cortex, without B 
capacitating somatic illness, and without pre 
vious attacks of mental illness. T'he patients 
status one year after discharge from the hosi 
pital was determined and categorized as 1?" 
Proved or unimproved. The records were © 
amined and 21 variables extracted which wi 
y appropriate statistical techniques, related E 
status one year after discharge. Of the 21 i p 
ables, 11 were found to be of prognostic sign e 
cance at the .01 level of confidence. Th A 
were: affective expression, orientation, dire a 
tion of aggression, diagnosis, type of onset, g 
ation of illness, lengtk oí hospital stay, maÍ sii 
status, status on discharge, precipitating st‘ 
and amount of treatment. 


hi P F + eg tind 
This paper is concerned with precipita, í 
stress as a prognostic variable when all ine’ 
significant variables are controlled A "E 


3 : recip! 
“ Point scale was constructed for rating prec}? 


tating stress, Appropriate reliability and valid 
ity checks of the scale were made before it W 
used on the total population of cases. ne 
After all 486 cases in the total sample a 
lation were rated on the scale for precip ee 
Stress, they were divided into two crite, 
roups: those improved one year after ined 
charge fom WPIC, and those who rem e 
unimpvoved one year after discharge- in the 
were 232 in the improved group and 254 “ne? 
unitaproved. These two groups were un 
matched with respect to all the variables £° 


ake ie 
to be significantly related to outcome bY 
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fe oe until there were no significant 
tions ed pe means and standard devia- 
and unim S —_ between the improved 
ple iin bee A These controlled sam- 
improved numbered 90 improved and 90 un- 
two ation y A further check on these 
ten variables, oe the means of the 
ofa nioa, which did not meet the criterion 

ifferences ility value of .01, and no significant 
sample SaR found between the controlled 
with all signif on any of these variables. Thus, 
controlled, icant and nonsignificant variables 
Was the onl he variable of precipitating stress 
Was that T one left free to vary. The result 
Were found — significant differences 
Proved grou etween the improved and unim- 
Precipitati PS with respect to the amounts of 

ing stress involved in their illnesses. 


Reri 
ceived August 11, 1953. 
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Patient Cancellations Following a Sudden 


Cancellation by 


the Therapist 


Miriam Crowley McCue 


VA Mental Hygiene Clinic, Lowell, 


Psychotherapists and case workers often ex- 
Press the opinion that their canceling of a 
scheduled appointment will be followed by the 
patient’s cancellation of the next appointment, 
It is not unusual to hear that a Patient can- 
celed, or failed to keep, an appointment “in 
retaliation” following a 
therapist. Most therapists 


are varied. Others 
iously feel that “if 
” Still others may 


Not interested in 
ay stay away with hurt feel- 


y because their own interest 
er an interval without treat- 


he can cancel, I can too,’ 
think that the therapist is 
them, and they m 


Ings, or Stay awa 
egins to lag aft 
t. 


for the Patient, seve 
study of what sy den 
him. It seems in orde O start with 
objective approach and dete... Wit 


ý er 
often Patients cance] 8Ppoint, 


176 


Massachusetts 


therapists have canceled appointments with 
them. i 
If the therapist is uneasy about canceling 
such a count will tell how valid is his e, 
Perhaps therapists should ask themselves ster 
they believe that patients will cancel 2 ct- 
therapists do. If the likelihood of a patents a a 
ing-out is great, the therapist’s anxiety may ! 
crease — which only complicates treatments 
€ Present study was undertaken to can 
cover whether or not patients actually do È $ 
cel appointments after their therapist can 
as many therapists seem to believe. 


Method the 
k . from 
Subjects. The data were obtained world 
attendance cards of 94 male veterans of sly in 
War II who were currently or previou arg? 
treatment at a mental hygiene clinic i i itele | 
mill city in New Englend. There meupatio’y 
variation in the age, education, ae We 
al level of the patients. Most © ewer si 
weekly appointments, although garth a mo? 
twice a week, and some once or tw! seven © y 
Therapists of these patients ian tw? 
members of the clinic, specifically 


Shae P an 
chiatrists, four social workers, 
chologist. 


w 

s ist 
¿ nt record rap? 

Procedure. The appointme: 


in which 4 he Gnl 
examined, for instances in wh 


sents, Magn 
+h a patien™. ji 

canceled an appointment with 2 sider’ i he 

unexpected cancellations were © unt! cel 


` ow 
those of which patients did not pn suc a 
ay of the appointment. The nr for any uf 
lation Was the only one counte ma 


; 
Patient. The experimental a a 
of 47 Ss, was drawn from these cas 3 


aad’ of 
A control group, C, consisted < 2 
eht the appointment which ma 


| 


; 


Patient Cancellations Following Therapist Cancellations 


apist-canceled 

group member: 
Matched for ¢ 
from the start 
to as the 

@ppointmen 
therapy st 
ian bein 
Urther 
faving 


appointment of one of the E 
s. Thus 47 pairs of Ss were 
he number of the appointment 
Oe a ; this shall be referred 
is 7 pag eye A Matched 
attad EN rom the fifth one after 
Sie. he seventy-eighth, the me- 
nl eg teenth, The two groups were 
the car > emg patient, each pair 
Same total ny E therapist, approximately the 
ment dates a ia er of appointments, and treat- 
lo one sane similar seasons wherever possible. 
tver had i selected for a control who had 

appointment canceled by his ther- 


©, and i ; 
Rated here including, the sessions investi- 


he = four appointments be- 
Selb Fay = matched appointment. 
or nch o absence of each § was re- 
these eight appointments. 
Results 
in Oth groups on ae number of cancellations 
te Passing the ae he eight appointments en- 
neellatio, matched appointment. The 
Sa a used to include any ab- 
it, or intment, whether S actually 
merely failed to keep it. 


Table 1 


atient CÇ; 


Ta 
by pèle 1 presents 


ancellations before and after 


Nu 
P 
the Ma 
Appoint © Matched Appointment 
ent 
"foe 4 Group E Group C 
t 
3rd 
2nd 6 11 
ps 14 16 
h 7 11 
After ed aPpointment 9 a 
— 
nd 
Ird 6 17 
4th 11 12 
Th 10 10 
Dot} © data in i 
Doings that a Table 1 do not support the hy- 
is, i Tent a oo will cancel his next ap- 
tang, n a ed his therapist cancels, There 
8s a latio s a in the number öf patient 
Follos Oup D an m appointment. Only six 
thes eled the appointment which 


a . e a . 

Pists, This po ntment canceled by their 
> is only 14.9 per cent of 

Tapist cancellations. In other 


= 


Cases of t 
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words, about 85 per cent of the patients at- 
tended the first appointment following the 
one that the therapist suddenly canceled. Pa- 
tients seem to be more anxious to see their ther- 
apists after missing an appointment than to try 
to “get even” by canceling. The degree of asso- 
ciation between therapist and patient cancella- 
tions and attendances as determined by the phi 
coefficient is —.88. This value indicates that 
there is a marked negative association between 
these variables. 

Confirmation of one aspect of the negative 
relationship discovered here may be found in 
a comparison of the number of cancellations 
made by each of the two groups on the first 
appointment after the matched appointment. 
Cancellation by the therapists is foliowed by 
high patient attendance, and attendance by all 
the therapists is followed by high patient can- 
cellation. The chi-square test was applied to 
find the significance of these data. A fouriold 
contingency table was constructed showing 
the association of patient attendance and can- 
cellation in the two groups. The obtained chi 
square of 6.96 exceeds the .01 level of cont 
dence for 1 df. ‘The two groups can ther 
fore be said to differ significantly with respect 
to these cancellations. There were fewer can- 
cellations on the first appointment after the 
matched appointment in group Ë than in group 
G, and this difference is not the result of 


sampling variations. 


Discussion 

‘The cancellation frequencies in this study 
suggest trends which could be validated only 
by the selection of new groups. Perhaps the 
greater frequency of “before” cancellations in 
group C may be explained by the fact that the 
Ss for group C were selected because they had 
kept a certain appointment. This selection may 
have increased the chances of getting Ss with 
a high number of cancellations just prior to the 
matched appointment. Cancellations by Ss in 
group, C are consistently higher than those by 
Ss in yroup Æ on the four “before” appoint- 
ments, and are strikingly so on the first ap- 
pointment before the matched one. Where 
100 per cent attendance occurs, a fairly high 
llation has gone before. 
done by the therapist oF 
be imrortant—at least 


amount of cance 
Whether canceling is 
by the patient may not 
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for the attendance record. 


Matched pairs of Ss were used to deter- 
mine whether or not the two groups were se- 
lected from the same population, and did not 
differ with respect to their frequency of can- 
cellation on the four appointments preceding 
the matched one, Subtracting the number of 
“before” cancellations by each § in group C 
from those of the Paired § in group E yielded 
an Mait of —.40 with an SEq;; of -19. At value 
of 2.16 was found, and with 47 df, p is be- 
tween .02 and .05, indicating that this differ- 


ence must be regarded as one of doubtful sig- 
nificance, 


found for each pair 
The Mare was -13 with SE ut 24. The t value 
o «54 indicates that the Mait is not significant 


Miriam Crowley McCue 


Summary i . 

The purpose of this study was to investi- 
gate the hypothesis that patients will cancel the 
appointment which follows an appointment 
suddenly canceled by their therapists. Appoint- 
ment records were used to obtain a count of 
the cancellations of patients for the four ap- 
pointments before and four after the matched 
appointment selected for observation. The Ss 
were 47 clinic patients whose therapists had 
suddenly canceled an appointment with them, 
and 47 patients whose therapists had kept an 
appointment which they (the patients) also 
kept. The records revealed that only six of the 
47 Ss whose therapists were absent for an ap- 
pointment canceled their next appointment- 
Thus the main hypothesis was not verified. A 
Statistical analysis of the data revealed a sig- 
nificant difference betwee: 
spect to the numb 


umber of cancellations 0c 
curred not only immediately after, but also 
immediately before, the matched, i.e., kept, ap“ 
Pointment, Further Studies on new samples are 
needed to confirm discoveries made in this tally- 
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The Comparative Effectiveness of Individual 
Psychotherapy, Group Psychotherapy, and a 
Combination of These Methods’ 


George O. Baehr 


VA Hospital, Danville, Ilinois 


A Tay 
aoe piy of psychotherapists [8] re- 
methods can copeici, the notion that group 
emotional di e effective in the treatment of 
ave Te Yet, psychotherapists who 
notably Slavs group methods systematically, 
urs [2] ‘in [9], Klapman [5], and Drei- 
therapy pi ath contended that group psycho- 
Certain fod only effective but that it affords 
Vidual ites an not obtainable through indi- 
Individual ie According to this contention, 
Pected to A tae psychotherapy can be ex- 
er benefit ee ement one another to the great- 
tion was oh he patient. The present investiga- 
Within the ea to test the hypothesis that, 
Patients by mits to be set forth later, treating 
Vidual 3 combination of group and indi- 
treatin e otherapy is more effective than 
& them by one method alone. 


Effective Procedure 
T eg as a measure of therapy, does 
ole fp ed accepted criterion. Ef 
of th therapy might be evaluated in 
Usocig re e patient s tendency to act out an- 
Tespect ts pulses, it might be evaluated with 
© future me ability to plan realistically for 
erms of E or again, it might be evaluated in 
farn a livin; patient’s ability to hold a job and 
ectivenese etc. The criterion of therapeutic 
contene ee in the present study is 
© criter} nt. Discontentment was chosen as 
F the nt because it is the central problem 
Mennene hee who voluntarily applies for 
Bator as ; ecause it is regarded. by. the investi- 
fall int the focal expression in corisciousness 
Ta- and interpersonal conflict and mal- 


ectiy, 
tering 


t : , 
ille, ne Veterans Administration Hospital, 
Sted inois. The data for this study were 


in at A 4 
es, Ili the Veterane Administration Hospital, 
nois, 


179 


function, and because it can be represented in 
quantitative terms. Conceptually defined, dis- 
contentment is the sense of ill-being coupled 
with dissatisfaction. Operationally, it is de- 
fined by a scale which was especially designed 
to measure the subject’s discontentment level. 
This scale, as viewed by the subject, allows 
him “to show how much he is bothered” by 


each of his symptoms. 
The Discontentment Scale [1, pp- 44-57] 


consists of 230 statements describing potential- 
ly discontentment-arousing experiences involv- 
ing persons, the supernatural, sex, body func- 
tions, thought processes, the senses, the € 
ideal, the superego, etc. The subject is re- 
quired to place each statement which is true 
about him on an eight-interval scale to indi- 
cate the intensity with which each experience 
troubled him during the past week. 

The average value that a subject assigns to 
the statements is taken as the best single index 
of his level of discontentment during the week 
immediately preceding the examination. It 
needs to be emphasized that the Discontent- 
ment Scale yields an index of the intensity of 
experience. The index is not based on the num- 
ber of experiences, as in the MMPI [3], nor 
is it based on the frequency with which ex- 
periences occur, as in the second section of the 
Inventory of Psychological Problems developed 
by the Air Force during World War II [4, p. 
71]. 

By means of a suitable “formula, the scale 
value: are converted to discontentment indices 
ranging from 0 to 100. For a sample of 86 
newly hospitalized patients, the 24-hour test- 
retest reliability of the discontentment index 
was found to be +.84; whereas for a sample 
of 28 patients about to be discharged after the 
completion of their treatment, the 6-hour test- 
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retest reliability was found to be +.96. On 
two samples (N = 10; N = 11), the discon- 
tentment index was found to have an average 
product-moment correlation of +.47 with the 
ward physicians’ estimates of the patients’ need 
for treatment. 

Each subject was given the Discontentment 
Scale at the beginning and end of his period 
of hospitalization. The effectiveness of psycho- 
therapy for each individual was determined by 
calculating his relative movement index using 
the formula: 


100 (d; — di) 
m, = — 
d; 


i 
where 


m, is the relative movement in the discontentment 
level, 

d; is the discontentment level before therapy (the 
initial discontentment level), and 

d; is the discontentment level after therapy (the 
terminal discontentment level). 

The relative movement index has been found 
to have a product-moment correlation of +-.66 
(N = 66) with the patients’ own evaluation 
of the amount of benefit derived from their 
period of hospitalization. 


In the present investigation, the experiment- 
al population consisted of 66 World War II 
hospitalized, male veterans ranging in age 
from 20 to 58 years, with the median age at 
30. They met the following criteria: volun- 
tary admission for treatment, voluntary dis- 
continuance of treatment and discharge from 
the hospital, a diagnosis of psychopathology, 
and legal competence, T hese criteria, rather 
than narrow diagnostic Categories, were made 
the basis of selection because of the well- 
known unreliability of the latter [4, p. 85] 
and because the criterion of psychotherapeutic 
effectiveness employed was felt to be appropri- 
ate only for voluntary patients, Diagnostically, 
the experimental population consisted of 2 ear- 
ly schizophrenics, 1 manic-depressive of the de- 
pressive type, 40 psychoneurotics, and 23 pa- 
tients suffering from character and behavior 
disorders. The subjects were treated with non- 
directively oriented individual and group psy- 
chotherapy in various Proportions and divided 
into the following categories: 

A. Those treated predominantly by group ther- 
apy 

B. Tuose treated predominantly by individual 
therapy > 
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C. Those treated by an approximately equal 
amount of group and individual psychotherapy 

D. Those treated predominantly by one method 
of psychotherapy, i.e., categories A and B combined. 

Division of the total experimental popu- 
lation into these categories was accomplished 
with the aid of the formula: 


—_G=T 
GI 
where 
G represents the hours of group therapy, 


I represents the hours of individual therapy, and | 


R represents the ratio of the difference hanem $ 
group and individual therapy hours to the tota 
number of hours in psychotherapy. 


R has a negative value if individual therapy 


exceeds group therapy, has a positive value if 
group therapy exceeds individual therapy, and 
is equal to zero if the amount of time spent in 
each is the same, 

Two different procedures were used to test 
the hypothesis. 

1. In procedure 1 the 66 experimental pa- 
tients were divided into three categories. The 
17 patients (approximately 25%) who had 4 
predominance of group therapy (R = +4) 
formed category 4; the 16 patients (approx! 
mately 25%) who had a predominance of 19” 
dividual therapy (R = —1) formed category 
B; and the 33 patients (50%) who had a? 
approximately equal amount of group and o 
dividual therapy (R = 0) formed category C 
Each subject’s relative movement index se 
calculated separately ‘and the mean of thes 
measures was computed for each category" 
These means indicate the effectiveness of t 3 
particular methods of therapy applied to a 
categories. The ¢ test was employed to ss 
mine the significance of the difference betwee 
the means. Since the purpose of the invester 
tion was to determine the functional relatio 
ship between the methods of therapy a 
Movement in the discontentment level, Pie 
cautions Lad to be taken to ensure that H 
categories were not significantly different Wy- 
respect to other variables which might 1 J. 
ence movement in the discontentment n 
These veriables are the number of thet he 
hours, the duration of hospitalization, an® |. 4 
initial discontentment level. In no instance 
the categories differ on these variables at © 
the .10 level of confidence. 1p 

2. In procedure 2 the 66 experimenta 


| 


o 


ea, divided into two categories. Cate- 
SA eo of those 33 patients whose R 
ne tn pa a predominance of a single 
Sth oroeed my RI = 1) ; and category C, 
a ure , consisted of those 33 patients 
Eun nad R ee equal amount of 
group and individual therapy (|R| = 0). In a 
omen A it was found that these two 
PAn mice ered, to a statistically significant 
therapy ho j pa to the mean number of 
eke oe n order to equate the two cate- 
dl hee a i patients in category D who 
é aate. i number of therapy hours were 
whe had a i three patients in category 
were lim: he largest number of therapy hours 
Iminated [6, p. 448]. The two cate- 


Bories were th 
A en compara a ar- 
iables (cf. Table S on all control var 


— Results 
nahuli i 1, which divided the experimental 
inding that ch three categories, led to the 
Pon ed a a treated with both 
relative tinea therapy had the highest 
treated sr indeX whereas the category 
è lowest ominantly with group therapy had 
are in kee sci rig index. ‘These findings 
vestigation. ng with the hypothesis of the in- 
With res and suggest that the methods rank 
ows: on. to therapeutic effectiveness as fol- 
ual thera up-plus-individual therapy, individ- 
the fear alone, and group therapy alone 
Te at be effective). However, the findings 
at was BE only suggestive since the only ¢ 
confidence significant even at the .10 level of 
ion cach, was the one between the combina- 
sults for od and the group method. The re- 

Procedure 1 are shown in Table 1. 
vided on from procedure 2, which di- 
categories experimental population into two 
Seen ae are given in Table 2. It will be 
ifference the table that there is a significant 
Ween the (at the .02 level of confidence) be- 
relative m two categories with respect to the 
E Sron ovement index. This indicates that 
to be mae Plus-individual method was found 
Chothera re effective than one method of psy- 
OF the ir Py and thus confirms the hypothesis 
‘al le o gation. : 

Severa] e 2 also gives the statistical data on 
9 a variables. Within the limits 
perimental design, three of these vari- 
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Table 1 


Comparison of Group Psychotherapy, Individual 
Psychotherapy, and the Combination of 
These Methods 


(The relative movement index [mr] is the measure of 
therapeutic effectiveness.) 


Category (by R value) 


A B C 
Predominance Predominance Individual and 
of of group therapy 


Item mavehe tering aes approR mately 
N 17 16 33 
Mean m, +5.35 + 10.06 +-23.54 
t for O19 1.652 
difference 
between 
means 1,969" 


* Significant at the .10 level of confidence. 


Table 2 
Comparison of the Combination Method of Group 
and Individual Psychotherapy with the Situation 
in Which One Method of Psychotherapy 


Predominates 
index is the measure of thera- 


(The relative movement. 
N=30 for each category.) 


peutic effectiveness. 


Category _(by |R value) 
C D a 


Group and One method 


individual of therapy 
psycho- pre- Diff. 
therapy dominating betw. 
Variable Mean SD Mean SD means t 
m_ Relative 
movement index 425.98 25.22 + 6.87 81.82 19.06 2.529* 
G+ Hours of 
psychotherapy 23.63 18.82 20.27 11.81 3.86 .997 
H Duration of 
hospitalization 
in days 61.87 28.86 67.73 17.29 4.14 .662 
d; Initial 
discontentment 
index 53.17 17.38 52.03 17.20 1.14 .250 
d, Terminal 
discontentment 
index 37.83 15.35 45.10 14.14 7.27 1.875łt 


* Significant at the .02 level of confidence. 
ł Significant at the .10 level of confidence. 


ables, viz., the total number of therapy hours 
(G + I), the duration of hospitalization (H), 
and the initial discontentment level ~(d:) 
could inadvertently have functioned as inde- 
pendent variables, i.e., could have functioned 
to contribute to the difference between the 
relative movement indices. The statistical data 
in Table 2 indicete that this possibility is un- 
likely, since there are no significant diterences 
between the two categories cn these variables. 
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In addition to the significant difference be- 
tween the two categories with respect to the 
relative movement index, the table also shows 
a diiference (significant at the .10 level) in 
the terminal discontentment index, the cate- 
gory treated by the combination method hav- 
ing the lower terminal index. The finding of 
this relationship is consistent with the fact 
that, while the initial discontentment levels of 
the two categories were equal, the relative 
movement in the discontentment level of the 
category treated by the combination method 
of therapy was significantly greater. 


Discussion 

It is important that the limitations of this 
investigation be made explicit. 

1. A completely adequate evaluation of ther- 
apeutic effectiveness would take into account 
not only the degree and rapidity with which 

therapeutic changes are brought about but al- 
so the persistence of these changes after termin- 
ation of therapy. The present study deals only 
with the degree of change over the course of 
therapy. 
i The problem of the therapeutic goal, i.e., 

e criterion for therapeutic effectiveness, has 
many solutions. This research employed dis- 
contentment and the relative movement in the 
patient’s discontentment level as the criterion 
and the measure of the effectiveness, [CE 1, 
pp. 9-43, for a detailed discussion on the use 
of this criterion. ] 

3. The findings are limited to voluntary pa- 
tients with psychopathology. They should not 
be generalized, without further evidence, to 
involuntary patients. 

4. Although secondary sources of training 
and experience, and differences in the person- 
alities of the psychotherapists, are likely to 
have introduced a certain amount of eclecti- 
cism in therapeutic approach, the therapeutic 
atmosphere was, nevertheless, fairly uniform 
from patient to patient. The 12 Persons who 

administered the psychotherapy were all clin- 
ical psychologists trained in the nondirective 
methods of Rogers [7]. The therapy empha- 
sized personal problems and emotional expres- 
sion. In addition, in group therapy, group in- 
teraction was fostered. Lectures on psychology 
and other topics, and the giving of deep inter- 
pretations and advice were judiciously avoided, 
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The findings of this investigation must be un- 
derstood in the light of this setting. i 
5. In the present research, the expression 
“combined method of therapy” has meant group 
therapy followed by individual therapy. With- 
out further evidence, we cannot generalize to 
courses of psychotherapy in which this sequence 
is reversed or where group and individual psy- 
chotherapy are carried on simultaneously. 


Within these limitations, the findings of the 
present investigation permit the inference that 
the combination of group and individual psy- 
chotherapy is more effective than one method 
alone. They also suggest that, with respect 
to their effectiveness, the three methods rank, 
from most to least effective, as follows: the 
combination of methods, individual psycho- 
therapy alone, group psychotherapy alone. 

Various writers who have had experience 
with both group and individual psychotherapy 
have recorded clinical observations that have 
implications for the relative effectiveness of 
these methods used singly and in combination. 
At the International Congress on Psychiatry 
held in Paris in 1950, Dreikurs [2, p- 5 
stated that, in 1929, he quite accidentally 
stumbled upon the discovery that treating pa- 
tients in groups affords therapeutic benefit not 
yielded by individual therapy alone, Since that 
time, he has used group therapy as an adjunct 
of individual therapy, clearly implying that he 
considers the combination to be more benefi- 
cial, criteria not stated, than either metho 
alone. 

Klapman implies a similar ranking for e 
fectiveness when he writes, “as catalyst, fur- 
thermore, group therapy will be found ot 
cious in speeding the dissolution of resistanc® 
When in individual interview the patien 

y $ : him 
ceases to produce any material, shuttling ZA 
into a group session may not only help in one 
coming resistance but even be of diagnos 
importance” [5, p. 89]. Nolan D. C. L 
in his foreword to a volume edited by Slavs 
expressed himself more cautiously, wit 
“Experts ir. G; oup Therapy do not claim t K 
it is a substitute for individual treatment, Ily 
feel that it is indicated in special, carefu 7 
chosen cases, with a proper assignment aS cdi 
as the composition of the group is concern 
[9, p. 10]. 
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Seis the experimental results from pro- 

ilter are Taere conclusive in this respect, 

Esa ee oe with the clinical observa- 

ae es writers, insofar as the methods 

ft. ti s rank in the order: combined 

py A ws ual therapy alone, group thera- 
ast effective). 


T eee 

sttongy ental results from procedure 2 
of polls oe thag the combination method 
group or the; T effective than either the 
ficial po individual method alone. A super- 
quotations. ae may be inferred from the 
rom “ae Ae here are benefits to be derived 
y individual pc that cannot be provided 
stances and if dere under certain circum- 
arring the converse is also true, then, 
Would ex Possibility of interferences, we 

pect their combination to produce 


greate. 
r benefits than either alone. 


Alt 
ol ee bn present study and Dreikurs’ 
garding the oe the same conclusions re- 
Methods of ie ative effectiveness of the three 
tal Conditio; verapy considered, our experimen- 
Tective type of peg om essentially nondi- 
terapy) whic erapy (client-centered psycho- 
individu 1 ile Dreikurs used a directive type 
versed iis S Psychology). Also, Dreikurs re- 
Tst individ of the therapies, applying 
© eviden ual, then group psychotherapy. 
about com ce suggests that there is something 
Which perpiting group and individual therapy 
Pendent se for gseater effectiveness, inde- 
type ih the order of application and the 
Crapy ca erapy used. How far the type of 
and stil] S differ from those mentioned here 
Problem zonton with this generalization is a 
high or further research. Accepting the 


8 Probahit:. 
Pacity ability that group therapy has the ca-, 


to 2 . 
ther ae t individual therapy, the fur- 
© the pa on is raised for investigation: What 
“ch the Tticular therapeutic ingredients that 
"apy supplies? 
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Summary 


The investigation was designed to test the 
hypothesis that, within the limits described 
treating voluntary patients by a conbinetion 
of group and individual psychotherapy is more 
effective than treating them by one method 
alone. The findings strongly suggest that while 
all three methods produce beneficial results, 
the combined method is superior to one reach 
od alone. They also suggest that the methods 
rank themselves, from most to least effective, in 
the following order: group-plus-individual psy- 
chotherapy, individual therapy, group therapy. 


Received October 15, 1953. 
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Body Size and 


Sidney M. Jourard 


Body-Cathexis 


and Paul F. Secord 


Emory University 


In an earlier paper [1], the writers described 
a method for the measurement of body-cathex- 
is, and reported that body-cathexis — the de- 
gree and direction of feelings toward one’s 
own body — is related to anxiety, insecurity, 
and feelings toward the self. The present study 
tests whether the actual measured size of body 
characteristics is also a correlate of body- 
cathexis. 

This expectation arose from consideration 
of the popular stereotype of the male ideal, ex- 
emplified by the tall, broad-shouldered, muscu- 
lar hero in fiction and the movies, 


Method 

Subjects. Sixty-two male undergraduates 
from the introductory psychology course at 

ory University served as Ss, 

Procedure. Each S filled in a body-cathexis 
questionnaire. ‘This form, described in detail 
elsewhere [1], but since modified slightly, con- 
sists of a listing of 40 aspects of the body. The 
respondent indicated the nature of his feelings 
toward each item in accordance with the fol- 
lowing five-point scale: 

1. Have strong positive feelings, 

2. Have moderate positive feelings, 

3. Have no feeling one way or the other, 

4. Have moderate negative feelings. 

5. Have strong negative feelings, 

Only a few actual size measurements re- 
lated to the “masculine-ideal type” were feasi- 
ble. After compietion of the cathexis scale, and 
without prior knowledge, measurements were 
taken from each S (using a tape measure and 
scales) of his height, weight, shoulder width, 
ches. circumference in relaxed Position, ex- 
panded chest circumference, biceps circvmfer- 
ence with the arm hanging loosely, and biceps 
when contracted. 

Correlations were computed between these 
measurements and the corresponding cathexis 
ratings on height, weight, shoulders, chest, and 


muscular strength. 


Table 1 
Correlations between Body Measurements and 
Body-Cathexis 


Body-cathexis Body measurements 


Height Height —.55 
Weight Weight —.ot 
Shoulders Width of shoulders —.36 
Chest Chest (relaxed) — 33 
Chest Chest (expanded) —.37 
Muscular strength Biceps (relaxed) —.52 
Muscular strength Biceps (contracted) —-5+ 
*r=.33 at .01 level for df = 60. weight 
teta for weight and cathexis = +19; eta for height 


and weight-cathexis = .34 (F= 1.09, p> .05). 
Results ; 
As may be seen in Table 1, correlations S18- 
nificant beyond the :O1 level were obtaine 
for all variables except weight. The r’s signify 
that a significant portion of the variance un 
cathexis scores is accounted for by variation 1? 
actual size. The direction of the r’s indicates 
that large size is associated with strong, pos 
tive feelings toward the respective body part 
and small size with weak or negative feelings 


Discussion 

With the exception of body weight, the 
findings reveal that cathexis for body charac 
teristics pertaining to “masculinity” is relate 
to the size of relevant body parts. Large A 
is apparently a desired quality among males, 
and its presence or absence leads to contrast!” 
feelings toward related aspects of the ™4 
body. ope 
The absence of a significant relationship 
tween weight and cathexis (neither 7 nor 
reached significance) indicates that there PS 
simple relationship between these two varia’ t 
The 7 between weight/height ratio and we} 
cathexis was higher but still insignificant. 
Received September 24, 1953. 
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Validation of Rorschach Criteria for 
Predicting Duration of Therapy ` 


Robert G. Gibby, Bernard A. Stotsky 


> VA Mental Hygi 


e Clinic, Detroit, Michigan 


E. Wesley Hiler, and Daniel R. Miller 


University of Michigan 


Within the 


Peared in this mi two years, there have ap- 
With the use “a oe four articles that dealt 
“ration of ther sne Rorschach test to predict 
ar techniques rapy. Although they used simi- 
contradicted e = populations, these studies 
Jor aspects The other ina number of ma- 
Signed to few present investigation was de- 
ction mitt. some of these areas of contra- 
tiple which a view to discovering the prin- 
Order to dicine Ge for the discrepancy. In 
‘scribe the date the present design, we will 
ndings of "Lear issues in terms of the 
the previous investigators. 


Possibili 
Ro ers, sr o}. prediction. The first article, by 
no significan uss, and Hammond [5], reported 
etween ak difference on 99 Rorschach signs 
ental H tents at a Veterans Administration 
Or four oto Clinic who stayed in therapy 
Me times = sessions and those who remained 
r Cadow [ 47 ee However, Kotkov and 
ne “ inant Sinan obtained by the use of 
cores, R oh weighted combination 
finned een oor and FC — GF, which 
ed with 69 per cent accuracy be- 


e 

ln y i Ta stayed in nine sessions or more. 
of patient their formula on a second sam- 
cris dow cas individual therapy, Kotkov 
Nate with ap found that they could dis- 

M timulated i 9 per cent accuracy. 
Om dow, Auld ; the success of Kotkov and 
eraj wa wa ths Eron [1] tried the same 
of di OSpita] p of 33 patients in a gen- 
© discri: With no success. The’ accuracy 
ho | tween patients who stayed 
o left before nine sessions was 


cri š 
In an mination be 
52 De t Ose w 
Nt, which « 
» Which is only 2 per cent from 
ie 


T če 
1p 
Tom th 
VA z 
Regional Office, Detroit, Michigan. 
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Patients wi 
tho S with fewer than nine sessions 


chance. The number of responses alone dis- 
criminated significantly. With their cutting 
point of 19, the accuracy was 67 per cent. 
The present writers did an initial study 
shortly after the negative results of Rogers, 
Knauss, and Hammond appeared. In an at- 
tempt to determine whether the Rorschach test 
could predict duration of therapy for extreme 
attempted to discriminate between 


groups, we 
those who stayed in therapy for five sessions 


or less and those who remained for twenty or 
more. We did not attempt to establish a for- 
mula, but were interested solely in the speci- 
fic Rorschach signs which discriminated 

tween these two extremes. We were encour- 
aged by the finding that differences between 
those who terminated and those who remained 
were very significant for a large series of scores, 
proportion of them were corre- 
lated significantly with the number of re- 
sponses. Because we were partially successful 
in that endeavor, we are following it up with 


the present study. 


although a fair 


Sample and Method 


Subjects were selected from among patients 
at the Veterans Administration Mental Hy- 
giene Clinic at Detroit, Michigan. The 269 
patients in the study were predominantly neu- 
rotics, with some character disorders and am- 
bulatory psychotics included. The socioecon- 
omic level was predominantly lower and 19w- 
er middle. The average amount of education 
was eleven years; the average age, 30. Most 
of the patients were white, only 10 per cent 
being Negro. Excluded from both groups were 
disoriented psychotics, organics, females, and 
patients who were forced to terminate for 
reasons beyond their control, such as shift in 


186 


residence, etc. The precedent established by 
Kotkov and Meadow was followed. By the 
method of discrimination function, a formula 
that maximally differentiated between the 33 
continuing patients and the 51 terminators was 
derived. Then the obtained formula was vali- 
dated with a sample of 75 continuing subjects 
and 110 terminators. 

Cutting point. In our previous article we 
raised the possibility that the negative results 
of Rogers, Knauss, and Hammond might be 
attributable to their cutting point of five thera- 
peutic sessions. It did not seem reasonable to 
us to assume that a person who stays in therapy 
for six or seven interviews can be regarded as 
having gained significantly more from therapy 
than a person who stays for only four sessions. 
Kotkov and Meadow, who were partially suc- 
cessful in making predictions, used a cutting 
point of nine sessions; so did Auld and Eron 
who, although they did not discriminate sig- 
nificantly in terms of Kotkov and Meadow’s 
formula, did succeed with R alone. Some of 
our most significant results were based on the 
gine points of five and twenty sessions. 


We decided to include in the continuing 
group only those patients who had been in 
therapy at least six months and, preferably, 
were still in treatment at the time that the 
data were collected. Inclusion in the termina- 
ting group, then, required the patient to have 
been in therapy less than six months. The cut- 
ting point derived from this criterion turned 
out to be 19 sessions or less. 

Although 19 sessions may seem high as a 
point of division for the two groups, it was 
felt that, in attempting to predict continuation 
in therapy, it would be necessary to account 
for every individual who left treatment against 
the therapist’s advice. This made it necessary 
that the sample include an intermediate group 
of patients who terminated therapy between 
their sixth and nineteenth sessions. Presuma- 
bly, this group was more motivated than were 
the patients who dropped out between the first 
and fifth sessions. In theory, one might expect 

this group of patients to resemble the contin- 
uing group more than did the group which 
dropped out of treatment early, Analysis of 
the Rorschach data showed this not to be true, 
The patients in this group were more similar 
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to those in the one-to-five session, group than 
to patients continuing in therapy. For instance, 
the average number of Rorschach responses for 
this group was approximately 20; for the early 
“drop” group, also 20; for the “stay” group, 
31. In view of the test performance of the in- 
termediate group, our decision to place them 
with the terminators appears to have been 4 
wise one. In our previous article we sugyested 
that choice of a cutting point could influence 
the results considerably. For instance, by choos- 
ing five as a cutting point, Rogers, Knauss, 
and Hammond may well have misclassified 4 
considerable number of “drop” patients. The 
same issue arises with the samples of Kotkov 
and Meadow and those of Auld and Eron. If 
discrepancies should arise between the findings 
of the present study and those of the previous 
ones, one possible explanation could be the 
choice of different cutting points. 


Results 


1. The prediction formula. On the first 
sample, the formula obtained by the method o! 
discriminant analysis that best differentiate 
between terminating and remaining patients 
was 


Y =.00049 R + .00212 Total K + .000107 


The term Total K refers to the sum of all the 
K responses, none of which was weighted H 
any way. We applied thc formula to our pi 
sample. By using a cutting point of -02, W 
were able to differentiate between those W f 
terminated and those who remained wih 
accuracy of 68 per cent. On applying the fo 

mula to the second sample, we were a! 


Table 1 eae 
Frequency Distribution» of Y Scores for Remain 
and Terminating Patients 


Y-score class Sample I Sample T 
intervals R x R 
-06000 — up 1 0 1 F 
-05000 — .05999 , 2 0 2 0 
-04000 ~.¢4999 0 0 0 2 
-03000 = .03999 5 1 4 11 
-02000 — .02999 6 7 21 fe 
-01090 — 01999 14 19 35 4 
-00000 — .00999 5 24 12 íó 
Total V 33 51 75 
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eair ty per cent of the time those 

While 67 » an those who terminated. 
ly high to ae cent accuracy is not sufficient- 
practicing Pt this formula useful to the 
oee sale ae our results nevertheless 
ow and of Qf Aa of Kotkov and Mead- 
could be fou “ d and Eron that some sign 
nificantly tiene wiih would discriminate sig- 
minating, een continuing therapy and ter- 

I 

teas noted from Table 1 that the 
termination no more successful in predicting 
Proximately oe continuance of therapy. Ap- 
Correctly PE EE <4 of the terminators are 
iction of aa ied in the first group. The pre- 
approximatel pe in the second sample is 
Teceived a = per cent accurate. We have 
which he ommunication from Meadow in 
eadow E out that the Kotkov and 
Predictions ay i is only successful in making 
Not continue in the group of patients who do 
Ore eieae psychotherapy. While it yielded 
Broup in h; ct predictions for the continuing 
terminators bing the, accuracy of locating 
© cogent ir 88 per cent. He also makes 
uld and RA that the negative results of 
rom the REE experiment may have resulted 
cir continuing they used 21 patients for 
Ncontinuin & group and only 12 for their 
, and en group. We then wrote to Dr. 
<Tminators apa us with the scores of his 
of the 12 hese discriminated correctly in 
While Sess cases. The 67 per cent accuracy, 
; S high as that of Kotkov and Mead- 
as ours, was still much higher than 
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tho 88 high 
over-all a l 
org Ccuracy for both continuers and 
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Patients 53 


a the intermediate group of 
Pes cent y Sing .02 as a point of division, 
eg is vere classified correctly as terminat- 
Tom the COUP was almost indistinguishable 
Sent Were nly terminators, of whom 88 per 
“Upport t classified correctly. These findings 
Broup ae o Categorization of the intermediate 
A terminators. 
a the Otkov-Meadow formula was applied 
tents with B in our validation sample. Pa- 
er the os orare of .01132 were assigned 
on Ores t inuing group and those with low- 
Ne Der a the “discontinuing” group. Sixty- 
ent of the patients were classified cer- 
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fomm, be of some interest to remark on the. 
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rectly. This is slightly better than chance but 
considerably below the 69 per cent accuracy 
obtained in the studies of Kotkov and Meadow. 

2. Productivity (R) as a predictor. A com- 
mon finding in all these studies was that the 
total number of responses (R) was consistent- 
ly associated with continuance in therapy. In 
our sample both Total K and m correlated 
over .60 with R. Therefore, we decided to test 
the ability of R by itself to predict continua- 
tion. By inspection we found 35 responses to 
be the best point of division between remainers 
and terminators in Sample I. 

Forty-eight terminators and 21 remainers 
gave fewer than 35 responses; only three ter- 
minators and 12 remainers gave 35 or more. Ac- 
curacy of prediction was 71 per cent in Sample 
I. In the validation sample 102 terminators 
and 51 remainers gave fewer than 35 responses, 
while 8 terminators and 24 remainers gave 
35 or more, for a total accuracy of 68 per cent. 
Considering the two samples together, 69 per 
cent of the patients were classified correctly 
by use of R alone. These findings would tend 
to suggest that R by itself can predict as w 
as any group of Rorschach variables, provided 
that a suitable cutting point is chosen. This 
cutting point, however, may vary from clinic 
to clinic. Auld and Eron found that an R 
greater than 18 predicted quite well for their 
sample. 

The question inevitably arises as to how 
much better than chance were these predictions. 
For the entire sample, chi square based on a 
fourfold table was greater than 30, with 35 
responses as a point of division. This value was 
significant beyond the .001 level. We may 
consequently conclude that the number of cases 
correctly classified was better than chance. 

What would happen if one predicted ter- 
mination for every case? The accuracy of pre- 
diction would be roughly 60 per cent, since 
that is about the proportion of terminators in 
the sample. This prediction is only 9 per 
cent poorer than the best Rorschach variable. 
Although the difference is significant, the in- 
crement in prediction resulting from R is not 
very great. 

3. Productivity and intelligence. In order 
to explore the reason why number of responses 


discriminated between continuers and termin- 
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ators, Auld and Eron first correlated R with 
continuance. The obtained coefficient was 
+.55. However, when the verbal scale of the 
Wechsler-Bellevue was held constant, the cor- 
relation between Rorschach productivity and 
continuation dropped to +.07. In fact, the IQ 
scores gave better predictions of continuance 
than the number of Rorschach responses, with 
a biserial correlation of +.71, which was signi- 
ficant at the .05 level. 

The authors concluded that the Wechsler- 
Bellevue verbal scale was more useful than the 
Rorschach for predicting continuance in ther- 
apy. Before accepting as valid such use of the 
verbal scale, they felt that their finding based 
on 23 patients should be supported by evidence 
from cross-validation studies. 

This the present authors attempted to do. 
In the first sample there were 79 Wechsler 
verbal scales available, of which 37 were of re- 
mainers and 42 of terminators. The best cut- 
ting point was empirically determined at 100. 
A Verbal IQ score of 100 and up was con- 
sidered a favorable sign; below 100, unfavor- 
pe. Fifty out of 79 patients were correctly 
Cassified, a 63 per cent accuracy. On the val- 
idation sample, 54 out of 88 were categorized 
correctly, a 61 per cent accuracy. 

Inasmuch as our findings gave only qualified 
support to those of Auld and Eron, we decid- 
ed to study the relationship between R and 
Verbal IQ in our sample. For 165 cases where 

there were both Wechsler verbal scales and 
Rorschachs available, the correlation between 
R and Verbal IQ was +.24. The biserial cor- 
relation between number of responses and con- 
tinuance was + .38; between Verbal IQ and 
continuance, +.40. With R Partialled out, 
Verbal IQ correlated +.35 with the criterion, 
With Verbal IQ partialled out, R correlated 
+.32 with continuance. In our sample the re- 
lationship between R and continuance was not 
entirely accounted for by the correlation with 
Verbal IQ since K remained significant with 
the verbal score partialled out. The multiple 
correlation of R and Verbal IQ with continu- 
ance was +.50. Our findings do not support 
the contention of Auld aad Eron that the re- 
lationship between number of responses and 
continuance in therapy only’ demonstrates that 
more intelligent patients are more likely to con- 
tinue. 


R. G. Gibby, B. A. Stotsky, E. 


e| 
W. Hiler, and D. R. Miller 


4. Social class as a predictor. Ir a personal 
communication to one of the authors, Auld 
suggested that social class may be related to 
persistence in therapy. The present authors un- 
dertook to test the hypothesis that socioeco- 
nomic class was related to staying in therapy, 
the prediction that middle class patients would 
stay and lower class patients and unemployed 
patients would leave treatment. The sample 
was broken down into five classes: 


1. Upper middie—low managerial, highly skilled 
clerical, and professional workers. 

2. Lower middle — semiskilled and unskilled 
clerical and semiprofessional workers. 

3. Upper lower — skilled manual workers. 

4. Lower lower — unskilled manual workers. 

5. Unemployed, 


For the first sample there were 76 classifi- 
able subjects of whom 47 were classified cot 
rectly, most of them in the terminating gtoUP’ 
Sixty-two per cent accuracy of prediction was | 
achieved; the chi square was nonsignificant — 
though positive. For the validation sample, 
out of 177, 63 per cent, were categorized gor 
rectly. The chi square of 8.63 was significant 
at the .01 level. Since in both samples the tre” 
was in a positive direction — with mi t 
class people tending to remain in and lowe 
class people to leave therapy — the hypothes! 
that class is related to continuance in theraP y 
is supported in this study. E 

5. Interaction betueen patients and ther 
pists. A factor not considered in previous es 
vestigations which might exert consider 
limitation upon the predictive efficiency of * 
Rorschach test is the skill of the therapists 4° 
the nature of their resultant interactions W to 
the patients. We were fortunate to be ab Ti 
obtain data that not only bear upon this f 
teraction but may account in part for some 
the discrepancy in the results of other inve 
gators. ma 

Hiler [3], and Hiler and E. L. Kelly” f 
study as yet unpublished, did an analysis r 
patient-therapist interaction in order to : 
mine whether therapists differed in resPet ; 
the types of patients they were able to KEP 
treatment. The number of Rorschach y 
sponses, which was assumed to have as Ceat 
ponents productivity and motivation for : nts 
ment, was used to characterize the patie 
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T . . 
heir findings are reported brieflly below: 


1. It was fe 
aha oe found that whether or not unproductive 
ment ste? motivated patients remained in treat- 
though Wace part a function of the therapist. Al- 
ee P a a pte gre terminators did not dif- 
fs ntly from remainers g s 
therapists they did s on R, for most 
2. Pati 
, * Patients remaining i 
in respect re remaining in treatment were similar 
the thera seaman. on the Rorschach whether 
social ane ie a psychiatrist, psychologist, or 
minating, he same was true for patients ter- 
4 3. Produ 
© continu 
Pists emp 
With cont 


nwa ttig Rorschach was not related 
loyed in ene with the female thera- 
eian i his study, but was associated 
Pists, The Termal or patients seen by male thera- 
treatment pati bs therapists were able to keep in 
ut tended ‘A ie giving few Rorschach responses, 
(high R) © lose proportionately more productive 
4. Ther Patients. 

able to ene rated as warm and friendly were 
; Be more of the poorly moti- 
Rta rated EEE patients (low R) than were 
pherapist as cold and unfriendly. 

analytically -x judged to be most competent at 
ewer y oriented therapy lost proportionately 


Productiy wat 7 
Petent ones tive patients than did the less com- 


her > 

e wa sent . 

therapi as no significant difference between 
v 


ists rate P 

n an high on passivity and those rated 

nonproductive v, with regard to the proportion of 
e patients remaining in treatment. 


Discussion 


confirms the findings of previous 
CR the total number of Rorschach re- 
ance in tf ) is signifitanjly related to continu- 
Itself eee It was also found that R by 
a ee as well for both samples as did 

.B inant function using R, Total K, 

derived rida R and the discriminant function 
An the ae our first sample predicted better 

Kotkoy and Meadow formula which 


aw been deriv, une 
tients derived from a group of similar pa- 


T : 
with Sidings from these studies, together 
Verba ificant differences between groups On 

tentative a oe class, suggest 2 — 

ained were nelusions: (a) Patients w ho e 

ore prod » in general, more intelligent an 
Sess the heir ag (b) They appeared to pos- 
© cla ition and drive associated with the 
ersong ad and upwardly mobile lewer class 
2 Rreater merican society. (c) They showed 
"ponsible Gee of the psychological factors 

e for their problems and, although 


St Sur study 
Udies that. 
SPonses 


Midd] 
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they experienced greater anxiety, they were 
not incapacitated by their anxiety. (d) Pa- 
tients who remained in treatment tended, to a 
greater extent than the terminators, to have 
both the capacities and the motivational state 
required to make effective use of the psycho- 
analytically oriented therapy offered at the 
clinic [2, 3]. 

Auld and Eron correctly stressed the im- 
portance of cross validation of any preliminary 
findings. This we have attempted to do by val- 
idating the findings from our first sample on a 
second sample more than twice as large as the 
original. In our study the requirement of cross 
validation was met since the formula worked 
as well in the second sample as it had in the 
first. 

Auld and Eron also pointed out the need 
validity generalization ; that is, applying 
and different sample with 
This step would re- 


for 
the data to a new 
different characteristics. 
quire successive validation of the findings on 
a wide variety of patients in different clinics. 
There are a number of conditions limiting ap- 
plication of any such formula to different Pog 


ulations: 


1. Since the formula applies best to terminators, 
it may not apply as adequately in a setting where, 
for some reason, a larger proportion of patients stay 
in therapy. Our formula, derived from a group of 
veterans receiving treatment from a VA facility, 
must be assumed, until it is proved otherwise, to 
generalize only to similar populations. Patients at- 
tending an outpatient clinic at a private hospital 
where they pay fees and presumably come entirely 
of their own accord cannot be equated with a group 
of VA patients who draw pensions for neuropsychi- 
atric disorders unless there is definite evidence to 
show that such groups are equivalent. While this 
consideration should not necessarily prevent a for- 
mula derived from one type of sample from being 
applied to another, the limitations of such an appli- 
cation must be kept in mind. 

2. It has been shown that both the warmth and 
competence of the therapist may have an effect on 
the applicability of a prediction formula, It is hard 
to see how the operation of suc factors can do any- 
thing except decrease the predictive adequacy of any 
formula based on test material that does not take 
them into account. 

3. The type of therapy employed can have a di- 
rect bearing on the ability of a formula to predict. 
Our study was performed at a psychoanalytically 
oriented clinic where therapy is seen as primarily a 
long-term affair. At a clinic oriented to more im- 
mediate short-term goals,-the style of therapy, the 
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hoice of patient, and the criteria for determining 
aa tion and termination would probably be 
ee ierably different from nie ner cmead vale 
it clini view of these di 
ees seal & see how a formula could be 
TN redict equally well in all situations unless 
ebe were all relatively unimportant in com- 
parison with the patient’s personality, 


Premature termination is, then, not entirely 
a function of the patient’s personality and mo- 
tivational state, but appears to be influenced 
by the attitude and competence of the therapist 
and the type of therapy offered at a clinic. 
Does so-called “depth” therapy, which involves 
the manipulation of complex verbal concepts, 
make sense to individuals who are unable to 
handle such concepts? Would other therapeu- 
tic approaches succeed in keeping such individ- 
uals in treatment, and succee. 
their social adjustment? Studie: 
reported here are needed to 
sonality differences of remain 
ators in other settings and among therapists 
using different approaches to treatment. 


Suggestions for Further Work in 
% In an unpublished study, Hiler 
such personal data items 
tion, occupation, 

plaints to Predict cı 
what better than 


d in promoting 
s such as the one 
investigate per- 
ers and termin- 


Prediction 
[3] found 
as social class, educa- 
diagnosis, and initial com- 
ontinuance 


ot only are such 
binations of such 


Problem of predi 


l Certainly further re- 
search is needed in this area. i 


Summary 
1. By means of discrimi, 


‘ant analysis an at. 
tempt was made using Rors 


\orschach scores to pre- 
dict whether patients will continue Psychother- 


R. G. Gibby, B. A. Stotsky, E. W. Hiler, and D. R. Miller 


apy. A formula, Y = .00049 R + .00212 T 
tal K + .00010 m, was derived. When app os 
to a sample of 84 patients from bic 4 
weights had been derived, it correctly classi 
68 per cent of the subjects as continuing ie 
terminating therapy. On a validation samp 
of 185 subjects, 67 per cent of the panera 
were correctly classified. On the same samp 7 
the Kotkov and Meadow formula correctly 
predicted 61 per cent of the patients. 


2. Using the total number of Rorschach 1 
sponses (R) by itself, it was possible to ier 
sify correctly 71 per cent of the subjects in t 
first sample and 68 per cent in the second. 


3. For 165 patients the relationship bermea 
R and continuance was +.38. With Veka 
IQ partialled out, R continued to correlat 
significantly with continuance, thus contradic t 
ing the previous finding of Auld and Eron than 
with Verbal IQ partialled out, R correlate 
insignificantly with continuance. The multip 


correlation of R and Verbal IQ with contin 
uance was +.50. 


4. Social class was found to be related a 
continuance in therapy, with middle class pe 
jects tending to remain in and lower class $U 
Jects to drop out of therapy. 


5. The implications of these findings ve’ 
discussed, especially with respect to the relat! y 
importance of such factors as type of theren 
and warmth and cor ipecence of the thera A 
in the prediction of continuance in team 

It was concluded that Premature termina ae 
is not entirely a function of the patient’s ? i 

sonality and motivational state. Therefore, 


as 5 . iw 
, Predicting continuance in therapy, other d 


b. ou.: 
portant factors, such as those discussed, sho 


h : y elg 
€ considered and given their proper W 
In a prediction formula. 
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A Rationally Derived MMPI Scale 
to Measure Dependence ` 


Leslie Navran 
VA Hospital, American Lake, Washington 


This paper reports the development and 
initial use of an MMPI scale to measure de- 
pendence. An attempt to develop the scale em- 
pirically failed because experienced clinicians 
could not reliably rate dependence from case 
history summaries. A rational derivation was 
substituted. Sixteen judges independently speci- 
fied the MMPI items that they felt to bear 
on dependence. They further specified the di- 
rection of response which would be made by a 
hypothetical dependent person who was re- 
sponding frankly. Tetrachoric correlation co- 
efficients were computed for each pair of 
Rages, and the resulting matrix, when factor 
analyzed, yielded one main factor consisting of 
eight judges. The 157 items they collectively 
agreed on were screened for discriminability 
by internal consistency statistical procedures on 
a sample of 50 neuropsychiatric patients. A 
second very similar sample of 50 patients was 
used to cross validate the discriminating items 
so obtained. The same Procedure was repeated, 


1An extended report of this study may be ob- 
out charge from Leslie Navran, VA 


gress, 
o a 


using Sample II first and cross validating 0n 
Sample I. Fifty-seven items survived these tests 
and constitute the scale at present. Reliability 


is .91 for the 100 patients in the derivation « 


sample (Kuder-Richardson formula 20). . 

The Dependence Scale correlates .72 with 
Pt, .60 with the D scale, —.53 with K, 53 
with Pa, and .50 with Sc. To date, its use with 
known groups has yielded these results: (a) 
100 NP patients score significantly higher 
than 200 normals from the original MMPI 
standardization population (mean difference 0 
7.6 points; p < .001%. (b) These normals 19 
turn score significantly higher than 265 Stan- 
ford University graduate students (mean dif- 
ference of 3.81 points; p < .001). (e) The 
shape of the graduate student distribution p 
J curved, suggesting conformity to a cultura: 
expectation. (d) Within the sample of 100 
NP patients, character disorders score lowest, 
followed by neurotics ‘and then schizophrenics 
Differences are not significant between these 
groups, but nonparanoid schizophrenics score 
significantly higher than paranoid schizophven : 
ics ( < .04; ¢ = 2.08). 

These results are considered promising, but 
not necessarily conclusive. However, the scale 
seems worthy of more investigation and eX 
ploratory use. 


Brief Repost 
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Comparison of the Rorschach and MMPI 
by Means of Factor Analysis 


Harold L. Williams and James F. Lawrence 


Letterman Army Hospital 


ser joer of research papers have 
and the Ros eg separately the MMPI 
ave been mada poe few comparison studies 
ave Siplored . ak investigators [1, 4, 6] 
orms of the t te ationships between the group 
Tevealed stl, tests. T hese studies have not 
fie ditiintio ing association between them. 
when he as 1 was summed up by Ellis [5] 
Bree well ais oe that the MMPI does not 
and other boi the results of the Rorschach 
Correlation — tests. While failure to find 
"struments etween these widely used clinical 
ack of ha not he convincing evidence 
Da priori Pa ity for either, there seems to be 
ate; that i asis for expecting them to corre- 
is, clinicians who use both tests may 


Make ; 

Ke id : Ret 

Cither a predictive statements from 
sour à 

Cncieg”) rce (e.g., “he shows depressive ten- 


Se 

ction ratate factor analyses of Rorschach 
een publi h and MMPI variables have now 
oa ifferen ed [10, 11, 12]. Three studies 
A rement ı populations have established fair 
e Rori to the factorial composition of 
of Eder ie Even though a general factor 
the ese accounts for a high percentage 
€ other oe in the intercorrelation matrix, 
all ¢ ree actors found were rather similar in 
illiams studies. The five factors found by 
abeleq. and Lawrence [10] were tentatively 
c) AG) productivity, (4) intelligence, 
and ( ment, (d) lack of perceptual control, 

Wi shading. 
(7), heeler, Little, and Lehner [9], Tyler 
and Welsh [8] have agreed, essentially, 


descrip; p 
act ibing two major and two to three minor 


s a a the MMPI scales. On the basis 
rst two factors, Welsh* has developed 


1 Ww. 
el e y 
1953, sh, G. S. Persenal communication, April, 


scales which he labeled 4 and R. The 4 scale 
represents a dimension containing heavy load- 
ings on practically all of the complaint scales, 
particularly Pż and Sc. Judging from item 
content, one finds that the scale seems related 
to excessive preoccupation with the psychiatri- 
cally negative aspects of the self: rumination, 
worry, and pessimistic attitudes. The R scale, 
based on the second major factor, is correlated 
positively with D, K, and Hy, and inversely 
with Ma. Welsh suggests that the scale may 
relate to expressive-repressive personality traits. 


Problem 


The purpose of the present paper is to Te- 
port the results of a factor analysis of the 
MMPI scales, certain Rorschach determinants, 
and the Wechsler-Bellevue Verbal IQ of 100 
psychiatric patients selected at random from 


the files of the Clinical Psychology Section at 
Letterman Army Hospital. The 32 variables 
lated can be found in Table 1. 


which were corre 
The MMPI symbol Es (variable 30) re- 


fers to a scale recently developed by Barron 
[2] for the purpose of predicting response to 
psychotherapy. The scale, which is inversely 
related to 4, held up rather well on cross val- 
idation. Furthermore, among normals it was 
found to be correlated with high ratings on a 
number of characteristics, such as resourceful- 
ness, vitality, self-direction, tolerance, self-con- 
fidence, breadth of interest, emotional out- 
goingness, spontaneity, and intelligence. Sow 
scorers were described as effeminate, submis- 
sive, and introspective. He suggested, there- 
fore, that individual differences on the scale 


could be considered ‘a function of ego strength. 
Table 1 shows the intercorrelations com 
puted from raw scores for the 22 variables. 


While the Pearson correlation coefficient was 
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Comparison of Rorschach and MMPI by Factor Analysis 


‘Table 2 
Centroid Factors 

Variable 
No. Symbol I wt mm Ww P 
x 56 54 22 -32 75 
3 76 24 -32 39 89 
‘ > 56 33 -18 18 49 
aj 58 30 -18 07 46 
3 1 43 17 -28 07 30 
# “4 59 10 -28 -28 51 
3% 42 40 26 16 43 
aa 42 23 32 -33 4 
— 61 29 -25 48 75 
T 37 21 07 -19 22 
i a 51 39 0+ 05 42 
: 5. 34 21 -03 -28 24 
i os 63 18 -26 -14 52 
o s 41 45 37 -i1 52 
nS 22 27 24 -28 26 
-20 15 


10 02 -31 


17 
R 87 39 34 106 


is 
19 4 30 38 26 02 30 
2 F 00 16 20 30 16 
2 k 27 -75 -23 18 72 
2 F 19 30 45 10 34 
3 p 35 -67 18 38 75 
$ Hy 26 -6) 32 41 81 
5 Pa 24 8 48 43 70 
26 Pa 42 69 17 -35 80 
x Pi 32 -72 o5 -18 66 
By Sc 37 -85 -18 18 92 
3) Ma 39 -87 -25 -07 9 
4 È 3a -32 a w 
a 4 0 gg 15 a $ 


Us 
cien Etween 
t, 
Varia Were tory 2) scales, tetrachoric coeffi- 
les,2 between MMPI and other 
ith 


Minap, TEW excepti 
Clinical, are ae a se the Rorschach deter- 
orre, Sal ighly correlated with MMPI 


es 

» Se TF 3 

tive Ons, eto have significant negative 

and p Seciateq hese same variables are posi- 

Werage = i Es. W, d, M,&, Fe, CF, 

lation * Noted that 2 .40 with this variable. It 
Es has a respectable corre- 


Dor th 

ts 1 Verb 

Onst itron’ x al IQ, a finding which sup- 
: ed i k servations. As hac been dem- 

casing arlier studies, the M 

dere sel 


t 

e 

tter Electa Mple 

RopeMinan a or med was primarily composed of 

matj tach s [10], ge os analysis of Rorschach 
x, Variables „Original correlations between 


les 5 
were utilized in the present 
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scales are markedly intercorrelated. 

The intercorrelati rix 
by Thurstone’s n ei bee Baio oF 
y e J , and the analy- 
sis was continued until five factors had been 
extracted, at which time the residuals varied’ 
from —.18 to +.20.° 

The resulting factorial patterns were ro- 
tated orthogonally and obliquely, an oblique 
solution being obtained by the trial vector 
method [3, p. 204]. Unrotated and rotated 
factors (oblique and orthogonal) are shown in 
Tables 2, 3, and 4. Descriptions are based on 
consideration of all three solutions. 

Factor 1 contains high loadings on most of 
the Rorschach determinants and does not in- 
clude MMPI scales. It can best be considered 


Table 3 
Orthogonal Factors 
Variable 

No. Symbol y g ul TVs 
1 wW 46 70 -10 09 
2 D 90 -t5 6 02 
3 d 66 07 -28 -06 

4 M 61 13 -26 0 
5 FM 45 -02 -33 -03 
6 m 40 16 47 20 
7 k 53 33 -03 -01 
8 K 23 55 -16 27 
9 F g3 -17 20 -13 
À 28 32 -17 12 

10 4 wo @ Dw = 
il c 23 30 -0 07 
p FC 51 14 65 14 
1 : CF 40 59 00 -07 
a A a A 
15 P 01 -02 -04 -03 
> R 100 o 2 z 
18 vblg 37 40 00 ii 

L 7 = e 

19 F o5 67 -25 53 
20 K 28 38 39 04 
21 Hs 21 -52 07 63 
22 D 14 49 03 64 
23 a o 2 48 53 
24 Pi ao ~% 03 86 
25 te See 70 
26 Pa ee -14 67 
27 oe a, 74 
c rf 9 
a @ SS s s 
0 Es 28 T v 83 
; A 2 w E 16 

31 16 11 51 
- ee 


2» _* h it 
y were 50 low that» 


sThe loadings 0° Factor vd 
was not included in later M 
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Table 4 
Oblique Factors 
Variable P 
No. Symbol ie mm mr w 

1 wW 33 82 -12 -23 
2 D 91 36 48 04 
3 d 65 41 -35 -10 
4 M 60 42 -36 -06 
5 FM 48 21 -39 -01 
6 m 37 30 49 11 
7 k 43 60 08 -15 
8 K 10 59 07 01 
9 F 86 33 -37 -05 
10 Fe 21 41 -12 -03 
11 c 51 55 -17 -13 
12 c! 18 32 -26 -06 
13 FC 50 36 48 06 
14 CF 27 72 12 -18 
15 a 02 46 06 -11 
16 P 06 -06 -35 -03 
17 R 99 60 4 -02 
18 VbIQ 27 54 08 -18 
19 B 16 15 20 -11 
20 F 11 47 -12 76 
21 K 16 51 33 -12 
22 Hs 19 -19 25 77 
23 D 09 -18 40 78 
4 Hy 11 02 54 60 
25 Pd -18 -05 09 82 
26 Pa -11 -27 -04 77 
Z. 13 45 09 89 
28 Sc Ot e T ST 90 
29 Ma -05 -11 -39 37 
Bo Es 19 7 0 +73 
31 A -05 -4 17 91 
UR “709559 


ee l å A 


a general Rorschach productivity factor. A 


similar factor was found in previous studies, 
but in the course of rotation much of its vari- 
ance was spread among other factors. As can 
be seen, rotation did not appreciably alter the 
esent study. This dimension 
of the total vari- 
matrix, and its 


scales have high 
Pt and Sc, whil 


K variables, 
nd KS The 


factors must be ~ 


Table 5 
Correlations between Oblique Factors 
Factor P j” I” iy” 
I” 1.00 
Il” 38 1.00 m 
v” Is a is 1w 


oblique and orthogonal positions are quite di- 
vergent. The peak loadings on the two solu- 
tions are similar, but the oblique axis includes 
a wider range of Rorschach determinants p3 
greater productivity. As shown in Table 5, the 
latter solution results in correlation between 
Factors I and II. 

From the loadings on Factor II, it seems 
reasonable to postulate that patients who a 
productive, giving a wide range of Rorschac 
determinants, who can organize the blots int? 
wholes, and who use color with some freedom 
will tend to deny concern with themselves, gs 
satisfaction, pessimism, and worry, thus gone 
ing a high Es score on the MMPI. In tht 
case, Factor II may be tentatively labeled “ego 
strength.” = 

Factor III is also bipolar, including sign! 
cant loadings on MMPI R (repression), Its 
K, D, and Hy, along with Rorschach F. 
opposite pole is made up of Ma and Romie 
R, D, M, FM, m, and FC. Perhaps it mê 
best be labeled “expressive-repressive.” is 

Factor IV, a general MMPI ae n ji 
closely related to the first factor obtaine je 
the several factorial studies mentioned abo y 
It seems to involve a set to say psychiatric® 
negative things about oneself. 


Summary and Conclusions 


T 

1. MMPI, Rorschach, and Wechsler-Belle 
vue data on 100 psychiatric patients pen 
lected at random from the files of the Car 
Psychology Section at Letterman Army 
pital. 


í 
. e a facto 
2. The intercorrelation matrix was f 


analyzed hy the centreid method. > 
3. Four factors were obtained and ne 
hile relationship between the two tests in 
not remarkable, there is evidence for anglap 
verse one. Two factors. demonstrated Dea 
between the two tests. Factor II, tentat! 


bed- 
S 


Comparison of Rorschach and MMPI by Factor Analysis 


“ 

i ee included high loadings 

iy oid MPI “ego-strength scale,” and a 

wt om ao range of Rorschach determinants, 

laine ; - loadings on the MMPI “‘com- 

os og Factor III contained high load- 
Grachack + MMPI “repression” scale and 

iene = » with negative loadings on the 

E as the MMPI Ma 
Fa 

ly oy a and IV were identified respective- 

MMPI“ orschach productivity and the 

iidicate eneral maladjustment” factor. They 

ance in Ara a considerable amount of vari- 

ation em a test is not accounted for by covari- 
4. The dat pisia 

able ieee suggest that a Rorschach vari- 

a reliable —_ that would function as 
5. Th oe ictor of ego strength. 

with en MPI findings are in agreement 

ts of previous factorial studies. 


Rici 
ceived August 17, 1953. 
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The Diagnosis of Subclinical Schizophrenia ` 
Donald R. Peterson 


University of Illinois 


One way to refine a scheme of psychiatric 
classification is to examine patients who, when 
certain developments in the course of their ill- 
ness have been considered, turn out to have 
been incorrectly diagnosed. Careful study of 
behavior recorded at the time of their diagnoses 
should permit more definite limitation of class 
boundaries and more accurate placement of 
other patients for whom a diagnosis is required. 

This study is concerned with the behavior of 
a group of veterans who should have been di- 
agnosed as “latent,” “incipient,” or “Subclinic- 
al” schizophrenics, but who in fact received 
some other designation, The importance of 
making the classification correctly for the pro- 

ion of other members of society, for pro- 
moting maximal economy in treatment, and 


generally for facilitating wise patient disposi- 
tion should be obvious. 


Subjects and Procedures 
Group 1. A se 
tained by searchi 


male, white 
criteria: 


a. They were examined by a Psychologist 
and were seen for at least two interviews by 
staff members at the clinic, 


b. They received some diagnosis which con- 
tained no derivative of 


the word “schizophre- 
nia,” 


c. They were later 
hospital and theré we 
phrenic. 

Group 2. A sam 
selected by examini 


sent to a psychiatric 
re said to be schizo- 


ple of true negatives was 
ng data previously recorded 


1 Published with the permission of the Chief 
Medical Director, Department of Medicine and Sur- 
gery, Veter-24 Administration, who assumes no re- 
sponsibility for the opinions expressed or the con- 
clusions drawn by the autor, 


‘control sam 


[+] for a sample of nonhospitalized patients at 
the same clinic. Each false negative in Groin 
1 was considered in turn, and was compare 
consecutively with each patient listed in the 
data for the nonhospitalized sample until one 
was found who had received a primary “i 
nosis identical with that given his counterpar 
in Group 1. For these cases, neither ine 
nor outpatient status was subsequently changed- 
The sample was again limited to male, white 
veterans, 

Group 3. An exhaustive sample of true pos- 
itives was found by searching the clinic files 
and selecting those patients who, as in the 
other groups, had received psychological lees 
psychiatric examination at the clinic, whose i 
agnoses were “latent,” “incipient,” or enb; 
clinical” schizophrenia, or “schizophrenia m 
remission,” and who later were sent to the hios 
pital and received some variety of the diag 
nosis “schizophrenia” there. Once more, 4 
cases were male and all were white. 

Groups 1 and 2 ¢ack contained 33 cases 
For Group 3, N = 27. Data were oe 
with regard to age, education, Wechsler-Bel -i 
vue IQ, and Minnesota Multiphasic rasa 
ality Inventory (MMPI) profile, and t x 
false negatives compared with each of the two 
ples by means, chiefly, of a 7? a37] 
ysis, as specified by McNemar [2, formula 8 
for 2 by & tables. This method was employe? 
or testing differences in education and for 19 
Vestigating the discriminatory effectiveness i 
six signs said by Meehl [3] to be esa 
employed in differentiating MMPI po 
profiles from neurotic ones. The signs, mO 


; ible: 
fied only to make objective counting possible 
are as follows: 


1. T scores on 
Over 70 


2. F> 65 
3. Sc> Pt 


tas ales 
four or more of the clinical sc 


198 


The Diagnosis of Subclinical Schizophrenia 


t Pa or Ma >70 
+ Pa or S¢ or Ma > Hs ar 

nd D and Hy 
6. D> Hs and Hy i 


ee statin the ¢ test was applied for all 

pen variables [1, formula 5.03]. Where 

ia suggested dissimilarity in population 

ret as method for approximating t was 

ate ve involves no assumption of homo- 
s variance [1, pp. 74-75]. 


Results and Discussion 


The di 
ee diagnoses actually received by the false 
Bon group are presented in ‘Table 1.* They 
o have been most often confused with 


Cases of 7 
: anxie Pi s, e iv Q 
rosis, ty reaction or mixed psychoneu- 


Table 1 


Primary Diagnoses of Patients 
in the False Negative Group 


= Diagnosis Number 
Ychoneurosis, mixed or 
À unclassified 3 
Nxiety reaction ? 
‘ONvers} i mi 
n reaction, hysteria 
en >matization reaction E 
Ssive- i i 5 
ie ve-compulsive reaction 4 
e quate personality s 
GER a i 
Psychiatric diagnoses n 


Diff : i 
Bence <a in age, education, and intelli- 
Pariso E not significant either in the com- 
cn Ge Groups 1 and 2 or that be- 
Scoxe roups 1 and 3. Examination of 
Sugge: means for the various MMPI scales 

e oe that the false negatives differ from 
thie 8 of Group 2 on six of the scales, 

with hey differ from the members of Group 
type regard to three scales. Results of this 
te are not revealing enough to warrant in- 

TPretation. 

— i analysis, even of the simplest kind, 
to yield far more meaningful informa- 

2 

A 
Sults ols of means, variance estimates, and re- 
MMPI significance tests for age, IQ, and the 

Scum, scales has been depesited with the American 
from fhe ae Institute. Order Document No. 4203 
Photog e ADI Auxiliary Publications Project, 

as plication Service, Library of: Congress, 
for 35 8ton 25, D.C., remitting in advance $1.25 
Copies ees microfilm or $1.25 for 6 x 8 in. photo- 
tion Se ake checks payable to Chief, Photoduplica- 

rvice, Library of Congress. 
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tion. A striking aspect of the profiles presented 
in Fig. 1 is the essential similarity between 
test patterns of the latent schizophrenics who 
were not correctly diagnosed and those who 


120 

~ 

ea Fase Necarives (N=33) 

os -=-= Teus Nesatives (N=33) 
---- Teue Positives (N 

a 227) 


60) 


T Scores 


70 


60 


50 


40 


39--_—+ 
2&EK E 


Us D Hy Pd MF Pa Pt Sc Ma 


Fig. 1. Mean MMPI profiles. 


were. When Meehl’s psychotic signs were 
tested, not one produced a significant x°. In 
terms of the test pattern, however, the patients 
in Group 1 are obviously very much unlike the 
sample of true negatives, even though, asd 
group, they had been given identical diagnoses. 
Every one of the six signs yielded a 4° signifi- 
cant at or beyond the 05 level. In view of the 
informal way in which the criteria were es- 
tablished, the results are surprisingly good. 
After-the-fact examination of the profiles 
leads me cautiously to suggest utility for one 
sign not included in this list or any other I 
know. It is the relationship between Hy and 
Pd—in inferential statement, a relationship be- 
tween the repressive, inhibitory tendencies of 
the patient, and his propensity for “acting out” 
whatever impulses he may have. The “signifi- 
cance” which it yields here has little meaning, 
but the sign does not appear to be mentioned 
in other studies [4, 5] and might be worth 
including in future investigations of this type. 
The implications furnished by the data are 
clear. Adequate information was there for ‘the 
diagnosticians to use; it just was not em- 
ployed as effectively as it might have been. By 
assigning to all cases one point for the presence 
of each sign, it is possible to derive a tot 
psychotic” score for any patient. When this 
was done, and a cutting score fè: class desig- 
nation placed betweer one and two, it was 
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found that 88 per cent of the incorrectly di- 
agnosed patients in Group 1 would have been 
accurately placed. This increase, however, 
would have been gained at the expense of in- 
correct diagnosis for 39 per cent of the cases 
in Group 2. A cutting score between two and 
three would have led to correct designation for 
67 per cent of the members of Group 1, and 
incorrect diagnosis for 18 per cent of the 
Group 2 cases. The over-all percentage of ac- 
curate classification would have been 74 for 
both cutting points. 

These figures are far short of ideal, but they 
offer some hope for nosologic differentiation 
that is considerably better than that which has 
been made before. Groups 1 and 3 are ex- 
haustive samples of their respective patient 
classes, and consideration of their relative 
sizes suggests that the diagnosis of subclinical 
schizophrenic is missed more often than it is 
correctly made. 


That the problem with which we deal is 
one of inaccurate diagnosis, and not one of es- 
sential change in the patients themselves, is 
Speested by the results of follow-up scrutiny 

19 members of Group 1 who were retested 
at the hospital, Neither configural analysis of 


Summary 

Refinement in 
be effected throug! 
ioral characteristics of grou 


prove diagnostic Precision. 

The present study 
agnosis of subclinic 
portant but difficult 


is concerned with the di- 
al schizophrenia, an im- 
diagnosis for the clinician 


"Z McNemar, 


Donald R. Peterson 


to make. Thirty-three patients had been ex- 
amined at an outpatient clinic, and had re- 
ceived there some diagnosis containing no form 
of the word “schizophrenia.” They were later 
hospitalized and were designated schizophrenic 
by staff members at the institution. 


Comparisons were made between this ae 
and another group of clinic patients, matched 
for initial diagnosis, with regard to age, edur 
cation, Wechsler-Belleyue IQ, and perform 
ance on the MMPI. Similar comparison 
were made between the criterion group an 
an exhaustive sample of 27 outpatients ae | 
like the first group, were later hospitalize' 
and diagnosed schizophrenic, but for bg 
the diagnosis had been correctly made at t 
clinic. -elli 

No differences in age, education, or intel is 
gence were found. Neither did any clearly a 
terpretable results emerge from analysis of t is 
MMPI by means of the ¢ test. Configural en 
alysis through application of a group of ee 
chotic signs, however, indicated that t 
MMPI patterns of the false negatives were 
essentially like those of the patients for whom 
the diagnosis, subclinical schizophrenia, a 
been accurately applied, and were substantially 
different from those produced by the group = 
patients with whom they had originally pe 
classed. Diagnosis made in terms of these SEY 
would have led to a considerable increase ! 
classificatory precision. 


Received August 14, 1953. 
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The Relationship between Anxiety Level 
and Several Measures of Intelligence 


ose 
J aD, Matarazzo, George A. Ulett, Samuel B. Guze, and George Saslow 
ivision of Psychosomatic Medicine and Departments of Medicine and Neuropsychiatry 
Washington University School of Medicine 3 


I s 
of s Phen: ati study we reported the results 
tion of pa ment involving learning asa func- 
Study used re: levels of anxiety [4]. The 
ivided into college sophomore Ss, who were 
anxiety Jey he groups, from low to high 
Score on dhs according to each individual's 
» Individ aylor Scale of Manifest Anxiety 
en 1 ne me with Taylor raw scores be- 
» while th Were given an anxiety rating of 
16.20, ae raw scores of 6-10, 11-15, 
of 2,3, 4.5 r 6-30, 31-35 were given ratings 
one § ih. , and 7, respectively. T here was 
With those a score of 40, who was included 
Sis of the Talo: an anxiety rating of Ks Analy- 
Teading fr aylor raw score distribution yielded, 
Ss al om 1 to 7, the following distribution 
along the seven-point scale: 4, 23, 27, 15, 
maze’ 8. The results indicated that human 
latinsha ne had a significant curvilinear re- 
Onl tee Sreang levels of anxiety when 
and a she to learn the maze was the criterion, 
num a Rniificant rectilinear relationship when 
Us a trials was the criterion of learning. 
s fe en time was the measure of learning, 
to 8s in : middle anxiety range were superior 
Wher oth the high and low anxiety groups, 
eas with the trials measure, Ss at the high 
i ii inferior to Ss in the middle and low 


twe 


differences 
ble for the 
abilities 
btained 


In 
an effort to evaluate whether 


aac 
di tere level were in fact responsi 
°f the oe found in the mean learning 
eren even groups or whether the ob 
Ence le were due to differences 17 intelli- 
cria Pan of the groups, two available cri- 
en of intelligence were used. Each S had 
tone) the 1949 edition of the American 
Erami on Education (ACE) Psychological 
One i aa for College Freshmen, furnishing 
erion. The other criterion was €ac 
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8's grade-point average for the previous year, 
his freshman year. 


46 
v 
> 
o 

1 42 
w 
o 
z 
w 
2 
5 38 
a 
w 
E 
T 34 

1 2 3 4 5 6 74 
ANXIETY LEVEL 
Fig. 1. Mean grade-point average for each of 


seven groups ranging from low anxiety (group 1) 


to high anxiety (group 7). 


When the grade-point criterion was plotted 
as a function of anxiety level, no differences 
were found; i.e., grades had no significant rela- 
tionship to level of anxiety. This can be seen 
in Fig. 1 where the mean grade-point averages 
for each of the seven groups are plotted. The 
function is essentially a straight line parallel 
to the abscissa. The Pearson r for these data, 
an insignificant value of —.08, confirmed the 
graphic impression. The value of the unbiased 
correlation ratio, epsilon, [5, pp. 319-324] 
was .00, and the chi-square test of linearity of 
regression [5, p- 319] based on this value and 
the corresponding Pearson 7 was -00, indicat- 
ing that the function does not, in fact, deviate 
from a straight line. Analysis of variance 
yielded an insignificant value of .88. The 
use of ¢ tests based on the pooled variance re- 
vealed only one significant difference, groups 
4 and 5 at the .05 level, and sines 21 tests 
were performed this can be considered a chance 
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occurrence. Thus the conclusion of no rela- 
tionship between grades and anxiety level ap- 
pears warranted. 


144 


132 


128 


INTELLIGENCE —ACE 


I 2 3 4 5 
ANXIETY LEVEL 


gos 2. Mean ACE score fo 
nging from low anxi 
ety (group 7). 


7 


r each of seven groups 
ety (group 1) to high anxi- 


The second criterion of 
scores, was analyzed next, 
The apparent 


intelligence, ACE 


» the Pearson r between 
ACE score and anxiety level was —.25, a val- 


ue significant at the .01 level of con 
dicating a slight but nevertheless significant 
negative relationship between ACE score and 
anxiety level. The value of epsilon of 25 (01 
level of confidence) is equal to the value of z, 
and therefore the value of the chi-square test 
of linearity is .00, indicating a rectilinear 
rather than a curvilinear relationship, 

As was pointed out in our earlier study, an- 
alysis of variance is liniited as a test of differ- 


fidence, in- 


J. D. Matarazzo, G. A. Ulett, S. B. Guze, and G. Sasloz 


ences among means with data of this type, for 
the reasons pointed out by Webb and La 
mon [9, 10]. Thus, with the ACE data : 
Fig. 2, we obtained an F value of 1.90, 
which is short of the 2.17 value needed for i 
nificance at the .05 level. Despite this lack 
significance for F, two-tailed z tests based a 
the pooled variance yielded four significant a 
ferences: groups 1 and 2 at the .05 level A 
groups 2 and 5, 2 and 6, and 2 and 7 my 
the .02 level of confidence. These values in S 
cate that we are dealing with true inca s 
rather than chance occurrences. However, t 
limitations of analysis of variance when bs 
variable is ordered (our anxiety yet 
should be kept in mind. Correlational tec 


z $ he 
niques, like those reported above, are thus t 
methods of choice. 


As with the data of our earlier study, the 
question of the small N (four Ss) in group “ 
was next raised. It is obvious that the N’s ra 
duly influence the nature of the curve shown be 
Fig. 2, since the chi-square test results indica 
that the relationshipėis a rectilinear one, i€» 
that the essentially straight line from ET, 
to 7 is probably a better indication of the re ]. 
tionship between ACE score and anxiety mee 
In an effort to test this, the data were na 
grouped as in the earlier study in an eBo 
increase the N in group 1. Since the 101 Ss i 
a range of Taylor raw scores from 1 to 40, 
was decided that grouping them into five K 3 
groups in intervals of eight Taylor points ti 
8, 9-16, 17-23, 24-32, 33-40) would be kinn 
fiable. The regrouping now placed 13 s ‘al 
group 1, 47 in group 2, 23 in group 3, 1 up 
group 4, and 4 in group 5. Thus, while go 

“1 changed from 4 Ss to 13, group 5 wi in 
duced to 4. Since it was felt that the the 
group 1, and not those at the high end of 
anxiety scale, was crucial, the 4 Ss in ol a 
Were included with the 14 Ss in group 4 t 
yielding four new groups. 


Figure 3 presents the relationship betwee’ 
E scores and these four differing levee on 
anxiety. As was predicted from the ss a e 
ship between the z and epsilon obtained for at? 
Seven groups, the use of broader categories ‘et 
ter represents the relationship between er 
level and ACE score. Statistical analysis be 
this out. 


—_—_—_— ees 
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A rer aE 


Anxiety Level and Measures of Intelligezce 


ou 
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Fig, 3 
minena ACE score for each of four groups 
ety (erup Naas anxiety (group 1) to high anxi- 


Th 
9 lglg r for the data of Fig. 3 was, 
level), Th still —.25 (significant at the .01 
Significant E th value of epsilon was .28 (also 
erence between, 01 level). As the slight dif- 
Cate, the val een these correlations would indi- 
tY of regre ue of the chi-square test of linear- 
Cance, Dales aa did not approach signi- 
03 (01 Hy ysis of variance yielded an F of 
Cated that evel), and analysis by ¢ tests indi- 
cantly diff groups 1 and 2 were each signifi- 
and 3 ey from groups 3 and 4: groups 
8 anit : and 4 at the .05 level; groups 
Cance, Th and 4 at the .01 level of signifi- 
indicate és se analyses and those of Fig. 
Score ang at the relationship between 
Curve in A agp level is rectilinear, and the 
this relatio 1g. 3 is the best representation of 
; tote AS Therefore it can be concluded 
significanti, appears to be moderately, although 
and that hy » Correlated with total ACE score 
the higher the anxiety level the low- 


Tron 

on th l l 
this test € average, is the obtained score On 
A - Analysis of the two paris of the 


the Siral that the relationship between 
Mately A d L scores and anxiety was approxi- 
e€ same. Both yielded negative Cor- 
Comparable to the one shown in Fig. 
in total score. . 

5 E ae a a lack of agreement between 
iginal ¢ nship of anxiety level and our two 

riteria of intelligence, an explanation 


relations 
Or th e 
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was sought. The Pearson r between total ACE 
score and grades was .51, significant at the .01 
level. As this value is very near the mode ofal 
reported correlations between these two mas 
ures [7, p. 120], it was not believed that our 
sample was responsible for the lack of agree- 
ment between the relationship obtained for anx- 
iety and each of our two criteria. Instead the 
answer was sought in the difference between 
our two criteria. 


As the ACE is a timed test, we wondered if 
the speed factor could account for the negative 
correlation obtained with increasing levels of 
anxiety. This hypothesis was strengthened by 
two further considerations: (a) our earlier 
study revealed a significant relationship be- 
tween anxiety level and the time measure of 
learning, and (b) clinical experience indicates 
that anxious Ss do not function efficiently un- 
der time pressure. We therefore decided to in- 
vestigate this hypothesis by retesting Ss, this 
time with a nontimed intelligence test. If the 
obtained function is a straight line parallel to 
the abscissa, i.e., shows no relationship betwee! 
this measure of intelligence and anxiety revel 
we can conclude that the hypothesis that the 
time factor of the ACE accounts for its nega- 
tive correlation with anxiety level is reason- 
able. 

The nontimed intelligence test used was the 
CVS, an abbreviated version of the Wechsler- 
Bellevue developed by Hunt and his associates 
[3]. None of the three subtests of this scale, 
Gomprehension, Vocabulary, and Similarities, 
is timed, and Ss were allowed, in a group ad- 
ministration, to take as much time as they re- 
quired to complete the scale. 


The results, when this criterion of intelli- 
gence (total CVS score) is plotted against in- 
creasing levels of anxiety, are given in Fig. 4. 
The data are shown as a function of all seven 
groups. As the figure demonstrates, and actual 
analysis revealed, the use of the broader cate- 
gories (four groups) gave an essentially simi- 
lar curve. Inspection of Fig. 4 indicates that the 
hypothesis that the time factor of the ACE 
may be responsible for the obtained negative 
correlation appears to be borne out. Statistic 


analysis confirms this impression, as the values 
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3.00 


2.00 


INTELLIGENCE - GRADES 


1.00 


1 2 3 4 5 6 7 
ANXIETY LEVEL 


Fig. 4. Mean CVS score for each of seven groups 
ranging from low anxiety (group 1) to high anxiety 
(group 7). 


of r, epsilon, and chi square? were —.07, —.14, 


and —1.72. None of these values approached 
significance. The value of F, .68, was insignifi- 
cant, and t-test analyses revealed only one, and 

herefore chance, significant (.05 level) dif- 
_ out of the 21 tests computed. Analysis 
of the relationship of C, V, and S, taken sepa- 
rately, as a function of anxiety level revealed 
three curves similar to Fig. 4. 


It can therefore be concluded that intelli- 
gence, as measured by the CVS, like grades 
as a measure of intelligence, is not related to 
anxiety level, However, the relationship be- 
tween CVS score and grades is not to be con- 
strued as a noncomplex affair, as the relatively 
low, although significant (.01 level) Pearson 
r of .34 between them demonstrates, This val- 
ue is typical of those re 
ures of intelligence and 
Finally, the Péarson r betw 
scores of .57 (.01 level) is 
finding [7, pp. 117-118]. 
stronger relationships among these various 
measures indicate the complexities introduced 
by the interaction of personality and intellec- 
tual variables, as well as the limitations of val- 
idity and reliability inherent in the criteria 
themselves. o 


6 
1 The negative sign results fro 

tive value of epsilon. This is 

and Van Voorhis [5, p. 555]. 


m the chance nega- 
discussed by Peters 


J. D. Matarazzo, G. A. Ulett, S. B. Guze, and G. Saslow 


The finding in this study of a slight p" 
nevertheless significant negative correlation 5 
tween total ACE score and increasing laes 
of anxiety is consistent with the results o 
eral recent studies. In a series of publications, 
Sarason and his associates have studied - 
lationship between anxiety, measured ee 
questionnaire sampling reactions to exam ig 
tions and intelligence tests, and various lea > 
ing, achievement, and psychometric cae g 
one of these studies Sarason and Mandler i 
demonstrated that low-anxious Ss as 
significantly better on two college entrance 
aminations (Mathematical Aptitude Test oe 
Scholastic Aptitude Test) than did Ss scor! ; 
at the high-anxious end. As in our study, a 
high level of anxiety was associated with 
performance on these two aptitude tests. nt 
thermore, these authors found no significar 
relationship between their anxiety measure an 
actual grade average for the previous yea 
work — a finding consistent with ours. of 
finally, their obtained significant er or i 
-21 (.05 level) between anxiety level an me 
20-minute timed intelligence test, the Henn A 
Nelson Test of Mental Ability, college ae ; 
again consistent with our correlation OË + 


the 
(.01 level) between anxiety level ane ia 
timed ACE scale. Thus, these two m is 
completed independently of each other.and Y 


if- 
ing different indices of anxiety as well > mg 
ferent measures of inżellectual functio 
yielded essentially similar results. 


sorting, and mirror t! 
[1]. It 9s of interest that several of P ne 
measures were timed. In the other exp pen 
aier obtained an index of anxiety-Tem* Ror- 
for each of his 11 Ss on the basis of thei! isti 
schach protocols and related this character for 
to cach 8’s performance on a variety of nd # 
lastic and other type tests [2]. He eet 
rank-order correlation between anxiety at 
ness and the L score of the ACE of eee 
7—39 between the Q score and anxiety- 


SS 


Anxiety Level and Measures of Intelligence 


ness, Thes 
e resul e in simi 
of oir study, ts are again similar to those 


The: vo 
of n tion of these findings, and those 
the oe is not to be drawn from 
personality E ea ia between a 
measures of rariable’ 1 anxiety”) and various 
are too low paripa ’ These correlations 
ings lies a e mi the importance of the find- 
with clinical T act that they are consistent 
area of frait paneer and they point out an 
valid meas research once new and more 
Interaction ied instruments are devised. The 
ables, So-ealh Personality and intellectual vari- 
Once the ne will receive much needed study 
een solved itis of objective measures has 
aylor sales specially for personality. The 
is one small step in that direction. 


T Summary 
hree 

ĉvaluateq 
anxiety f 


e of intelligence were each 
3 oe T0 on of increasing levels of 
UDs accordi z who were divided into 
cale of M ing to their-scores on the Taylor 
gted no ST a Anxiety, The results indi- 
rst i ere between anxiety level and 
ae average ihe of these criteria: grade- 
on a Onship Det score on the GV scale. The 
= E a the second criterion, score 
ee as found a and increasing levels of anxi- 
'Stically si o be a slight but nevertheless 

tin roin pets (.01 level) negative 
ris Scale via The fact that the ACE is 4 
“eis to aca ared to be a reasonable hy- 
ount for the negative correlation 


205 


obtina E use of the third criterion, the 
untime 7S scale, seemed to be: i 

C ar 

pothesis. E 
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Comparison of Two Forms of the 
Manifest Anxiety Scale 


Joyce B. McCreary and A. W. Bendig* 


University of Pittsburgh 


Taylor [1] reported the development of a 
Manifest Anxiety Scale (MAS) consisting of 
50 items drawn from the MMPI. Scores are 
obtained either by scoring only these items from 
the full-length MMPI or by embedding them 
in 175 additional filler items and giving the 
resulting 225-item test. Taylor [1, p. 287] 
mentions that distributions of scores obtained 
by these two methods are not similar, and the 
correlation between scores from the two forms 
was only .68 (N = 282). Commonly, the 
225-item test is used to identify anxious sub- 
jects, but this long test is not economical of 
either the subject’s or the experimenter’s time. 
Breferably only the 50 scored items should be 
given. to Ss, However, the results previous- 
ly quoted suggest that scores from this short- 


ened form might not be comparable to those 
from the longer forms. 


Students (N = 56) were given two forms 
of the MAS. Form A contained the 225 items 
described above, but only 50 of them, scattered 
irregularly throughout the’ form, were scored. 
Form B contained only the 50 scored items from 
Form A, all other items being omitted. In one 
section (N = 22), Form A was given first 
followed immediately by Form B. In the other 
section (N = 34), the forms were adminis- 
tered in reverse order. 

The 112 scores were converted to nor- 
malized T scores (“= 


3An extended report of this study may be obtained 
without charge from A. W. Bendig, Department of 


fron ty Publications 
Project, Photoduplication Service, Library of Con- 


gress, Washington 25, D.C., eemitting in adren 
$1.25 for 35 mm. microfilm or $1.25 for photocopies. 
Make checks payable to Chief, Photoduplication 
Service, Library of Congress, + 


50, SD = 10), based- 


S 


upon the performance of the norm group of 
1,971 students at the University of Iowa [l i 
Analysis of variance showed that the yapita 
between classes (which was confounded wi 
the order of presentation of the two test a 
and between forms was not significant. a 
ferences between the trials were significant ja 
the .05 level of confidence. Comparison of pie. 
means indicated that Ss tended to show lov ie 
(less anxious) scores on the second test a 
them regardless of form. The correlation - 
tween Form A and Form B transformi 
scores was .95: a similar correlation ang 
pairs of raw (untratisformed) scores was - 


The shortened form of the MAS on 
B) gave results almost identical with those i 
tained from the long form (Form A)- tion 
dently either form can be used for the wa 
of anxious Ss with equivalent results. fa 
Form B is more parsimonious in terms of € be- 
time, its use is preferable. The significant nce 
tween-trials term in our analysis of on 
Suggests an explanation of the differences £0 
by Taylor between scores from the full-len 
MMPI and those from the 225-item 
Many of the MAS items are near the sever 
the MMPI, and S has had to answer s€ The 
hundred other items before reaching nee ace 
“fatigue” effect found in our study may long 
centuated and compounded when an even 
er test is used. 


Brief Report 
Received February 8, 1954. 
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Rater Experience and the Reliability of Case 
History Ratings of Adjustment 


A. W. Bendig and Janine Sprague 


University of Pittsburgh 


In ; ; 

te discussion of the optimum 
Ypothesis ene eats [5, pp. 267-268], the 
Seven to iine vanced that longer scales, with 
with experien bs on pe should be used only 
Whereas short ced and well-motivated judges, 
atively naive ot should be used with rel- 
Place too mee. ges. Presumably, longer scales 
ability of a a burden on the discriminatory 
Y adopted Sagano raters. Although wide- 
Struction of >a guiding principle in the con- 
Pothesis has rating scales, this rational hy- 
ermine, ney ag far as we have been able to de- 
test, Previ ver been subjected to experimental 
Several of a research [2, 3] has confirmed 
INg ratin uilford’s strictures on construct- 
e th: Bi and has questioned others. 

e relationshi i was designed to clarify 
: St experien ps between scale reliability, the 
cale, Rater c of the rater, and length of the 
Pa is used here as task- 
to oad Bee Le., the amount of past 
2k or familiarity with the kind of 

quired of the rater. 


relevant 


Stim, u Procedure 
“i 
Word) % Ten short (approximately 100- 


eral ne histories were abstracted from 
Psycholog. monly used textbooks in abnormal 
turbeq con he cases ranged from mildly dis- 
Mose of i to institutionalized psychotic. 
© more t cases were reduced in length, with 
p Simplif ee wording either eliminated 
= 2 oole The cases were mimeographe 
Gael’ tater with a face sheet of instructions 
per A The instructions requested the 
“ends bef not to discuss the cases. with his 
m a jective. re rating, (b) to make his ratings 
ents + Ve aS possible, and (c) to make judg- 


“Nts in 
histories dependent of previously rated case 
` Scal, Gd 

es, ‘ ; 
7, or 9 Numerical rating scales with 3, 5, 


Categori 3 
egories were mimeographed on sep- 


E 
arate sheets with spaces for recording the rat- 
ings of the case histories. Three simple verbal 
anchors were used, one under each of the two 
end scale categories and one under the center. 


The anchors were: 
Slightly maladjusted 
Moderately maladjusted 
Extremely maladjusted 
Subjects. The total group of 208 raters was 
composed of four experience groups: 108 stu- 


dents in introductory psychology; 62 in the 
second semester of abnormal psychology; 29 
and 9 psy- 


graduate students in psychology ; 
chologists having the Ph.D. degree and several 
years experience in clinical or counseling work 
Most of the introductory students were fresh- 
men or sophomores, and they rated the cases 
sometime after the period in the course devoted 
to personality and behavior disorders. Almost 
all of the abnormal psychology students were 
juniors and seniors, with a large minority ma- 
joring in psychology. The graduate students 
ranged from first-year to fourth-year stu- 
dents, with a strong majority in clinical 
and counseling areas. All of the Ph.D. rat- 
ers were affiliated’ with this university or 
some neighboring agency in a clinical or 
counseling capacity and had a minimum of 
three years’ experience in service activities. 
For the first three groups, the case his- 
tories and rating sheets were passed out in 
class, and students were permitted to rate out- 
side of the classroom. The Ph.D. raters were 
contacted individually and also rated at their 
leisure. Scales with 3, 5, 7, and 9 categories 
were randomly distributed to the introductory 
and abnormal psychology students. Because of 
the smaller numbers of raters, and 5- and 7- 
category scales wee randomly distributed to 
the graduate students, and only cue 7-category 
scale was given to the Ph.D.’s. 
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Table 1 £ 
Reliability Analysis of Adjustment Ratings 

Number of Rater reliability Rater bias E 
Rater group N categories F GroupR Individual r F 

F 6 —. 
27 3 15.647* 94 35: 7 13 
e nn 26 5 17.76%% -94 39 1.15 = 54 
ae shag 21 7 19.68%% 95 47 -2.17* A 
ae 34 9 39.9738 97 253 2.69** 71 

5 5. 3.4+4** E 
l 13 3 15.20%% 93 52 “st 
- 15 5 12.99%% 92 44 2.76%* 9 
TAS 18 7 29.83%% 97 62 4.678" 79 
16 9 16.60%% 94 49 4.79%% be 

2.25% . 
Graduate 13 5 13.76** 95 58 2 7 
students 16 7 23.94% -96 .59 2.32%% 52 

Clinical Ph.D. 9 7 17.65%% -94 65 2.07* 


* Significant at the .05 level. 
** Significant at the .01 level. 


Results 


The reliability of the individual raters for 
each of the 11 subgroups was estimated by an- 
alysis of variance techniques [2, 3]. These re- 
sults can be found in Table 1. 

In general, individual rater reliability in- 

reased with higher levels of education, with 
tre Ph.D. group showing the largest reliability 
(r=.65). Consideration of the interaction of 


category scale, they surpass the abnormal psy- 
chology students using a 9-category scale and 


as. steep for the abnormal as it is f 
ductory psychology Ss, There was no differ- 
ence in the rater reliability found for the two 
graduate student subgroups using 5- and Ho 
category scales, and oth groups showed 
slightly smaller reliability than did the PhD. 
group. ., 

As to the magnitude of constant errors in the 
ratings of the subgroups (rater bias), the in- 


essive 
troductory Psychology Ss show a progr 


increase with longer scales, surpassing ale, 
Ph.D. group in bias with a 7-category = 
but not surpassing the graduate student hed: 
groups until the 9-category scale was en y 

he abnormal psychology raters consiste th, 
showed a greater bias for every scale a 
but again showed some fluctuation mane 
these subgroups, Of all four subgroups pai 
the 7-category scale, the Ph.D. raters sho 
the smallest bias. 


á ries 

f tor! 

The mean ratings of the ten case hisi an 
by the 11 subgroups were intercon |g the 
the matrix of coefficients found.? Al p (the 
55 correlations were ‘extremely hig at the 
median being -90), with 54 significant orrels 
-01 level, df =8, and the spear E 
tion, r=.73, significant at the .05 sot 4 
centroid factor analysis was poora twice 
these correlations, replicating the reagent 
to stabilize the communalities; the Co Fac 
factor loadings can be found in Table factor 
tor extraction was terminated after two Factor 
cause of small residual correlations. for a” 
I was a road general factor ve a 2 mea 

average of 91 per cent of the variation i 
be- 
ns 

1A one-page table showing intercorrelatior a 
tween meai, adjustment ratings of eleven a oct 
Taters has- been deposited with the unei oe from 
Trentatlon Institute. Order Document No. t A 
the ADI Auxiliary Publications Project, ashing 
uplication Service, Library of Cong r35 mi 
ton 25, D.C., remitting in advance $1.25 oes, ak 
microfilm or $1.25 for 6 x 8 in. photocopies ice 


asus r 
checks payable to Chief, Photoduplication Se 
Tibrary of Congress, 


=o. sli a 
NRE 


ay 
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Table 2 


Factor i 
Loadings from Analysis of Intercorrelations 


betw 3 
ween Mean Adjustment Rating of Rater Groups 
” Number of Factor 
7 Group categories I Il h? 
ntrod 
deine 3 4 = —37 102 
stile 5 95 —24 96 
q a 7 97 —i8 97 
7 9 95 —23 
j Abnormal 3 2o 
3 90 1583 
Psychology 5 95 A 
k students 5 17 93 
7 96 20 96 
~ 9 
Graduate A - 15 96 
Students 7 = 28 A 
| Clinical Ph.D. 7 97 i on 
x cent of total 
ater variance 91 á 96 
ae 5 
Decimal Doints omitted. 
Case hi 
Si ` 
tion of rd ne a and appeared to be a func- 
ing a he ength of the scale. Subgroups us- 
higher eae scale consistently showed 
8roups Usin ings on Factor I, and the two sub- 
oadings, To 3-category scales had the smallest 
Cent of eo II was associated with 5 per 
ance and y remaining intragroup rating vari- 
ackgrou oe clearly related to the experience 
actor in ta the raters. This “experience” 
ubgroups } ‘polar, with the four introductory 
ther sub having negative loadings and the 
y Of th groups spaced along the positive side 


Ounted 
Can 


er A 

nonparametric rank test of Kruskal 
e [6] was used to test the above in- 
n of I as a scale-length factor and 


Pog Wall 
Pretati 
as an 


ter 


U 


three - rank test to the sums of ranks of the 
Perience groups on Facto: I gave an 
30, which is not significant at the 
ce sum While applying the same test to the 
PE 5 G ranks on Factor II yielded an H 
hidh is significant at the .01 level 
ön J. Again the 11 subgroups were 
each factor and the sums of ranks 


g 
Value 9 


(6, p, 
Tanke 


level 


Istory ratings. 


e ve 
ctor. In all, these two factors ac- 


for s 
96 per cent of the variance between 
case h 


for each of the four lengths of scale obtained. 
The H test for Factor I was 7.48 (significant 
at the .05 level) and for Factor II, H equalled 
3.17 (not significant at the .05 level). These 
tests of significance support our interpretation 
of Factor I as related to scale length and Fac- 
tor II as associated with rater experience. Ob- 
jection may be raised to our interpretation of 
Factor II since our experience groups did show 
a general increase in rater reliability from in- 
troductory students to Ph.D. clinicians. The 
interpretation of Factor II as a “reliability” 
factor does not appear plausible when we note 
the large overlap in rater reliability between 
the introductory and abnormal student groups 
(Table 1) and the complete lack of overlap 
between these groups on Factor II. 

Finally, the above Factor II results sug- 
gested the hypothesis that the introductory-ab- 
normal-graduate student groups should show 
a progressive increase in the correlation of their 
mean case history ratings with those of the 
Ph.D. group. The average correlations of the 
two introductory, two abnormal, and two 
graduate student groups who used the 5- and 19 
category scales with the Ph.D. group wer 
found and tested for significant differences by 
the r-to-z technique described by Edwards 
[4, pp. 132-136]. The critical ratios resulting 
from these comparisons can be found in Table 
3, The introductory group showed a signifi- 


Table 3 


Significance of the Differences between Average 
Correlations of Three Rater Groups with the 
Clinical Ph.D. Raters 


Critical ratios 


Group N > Abnormal Graduate 
Introductory 47 87 1.88* 3.37** 
Abnormal 3396 : 1.07 
Graduate 29 97 


* Significant at the .05 point. 
** Significant at the .01 point. 


cantly smaller average correlation with the 
Ph.D. group than did the abnormal or gradu- 
ate student groups, on a one-tailed test cor- 
responding to the abeve directional hypothesis. 
However, the comparison of average correla- 
tions of the abnormal and graduate student 
groups with the Ph.D. group showed no sig- 
nificant difference. 
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Discussion 

The results of this study appear sufficiently 
unequivocal to question seriously the Guilford- 
sponsored statement that longer scales should 
be used only with experienced raters. Our re- 
sults suggest just the opposite: for more re- 
liable ratings longer scales should be used with 
inexperienced raters and (tentatively) short 
scales can only be resorted to when the raters 
have had experience in the type of judgment 
required. As a rationale to explain our results 
we suggest that inexperienced raters are more 
likely to disagree as to the scale placement of a 
particular stimulus than are experienced raters 
and disagree to the extent, approximately, of 
one scale category. With long scales this one- 
category disagreement represents a much smal- 
ler percentage of the total rating variance than 
with short scales. Since rater reliability is a 
function of the ratio of rater disagreement vari- 
ance to the total variance, we would expect 
shorter scales, with smaller total variance, to 
yield less reliable ratings. However, experi- 
enced raters can better tolerate the compres- 


ion of the scale and better maintain agreement 
with short scales, 


Parenthetical] 
results are a trib 
Ph.D. clinicians, Since we wanted to compare 
ratings from all 
tinuum, both ou 
chors had to be 


many of the Ph.D. clinicians justifiably felt 
that our case historie 


complete for them to 


the average interco 
Ph.D. clinicians 
judgment had a reliability of .94, 
with more complete case histories and with 
a better definition of what we meant by “ad- 
justment,” these reliabilities would have b 
increased. 

The factor analysis of the intercorrelations 
of mean ratings indicates that the largest in- 
fluence in these correlations-is the length of the 
scale. Factor ', which is fairly clearly related 
to scale length, accounts for 91 per cent of the 
total variability in the mean ratings. Factor II 


r group 


een 


Doubtless- 
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was even more clearly an experience factor, 
but only tapped 5 per cent of the rating vari- 
ance. We must admit at this point that the 
difference between our major experience 
groups, which is related to Factor II, is com- 
posed of a number of different variables. Pre- 
sumably there are differences in age, ae 
gence, educational training, motivation, an 
sex percentages between introductory, abnor- 
mal, graduate student, and Ph.D. grail 
Which of these organismic variables are i 
responsible for differences in rating can only 
be a matter of speculation at this point. How- 
ever, the academic selection processes that 
operate to winnow from introductory A 
chology a small group who will receive t 4 
Ph.D. also operate to increase the agree” 
among the raters as to what constitutes ma 
adjusted behavior. This selective process ap” 
pears to be most influential between the intro- 
ductory and abnormal psychology courses a 
is probably related to whatever factors deten 
mine that students will become majors in Psy 
chology. 4 s 
The increasing reliability of naive rater 
with longer scales found in this study coi 
trasts markedly with the results of previou® 
Studies [2, 3]. All three of these studies 1° 
quired self-rating on the part of the rater, Nal 
using the scale to report the rater’s perception 
of his own feelings, preferences, etc. In E 
former studies, scale rel‘ability did not p 
edly increase with longer scales. In the pres¢ ie 
research, the raters were asked to eval 
stimuli that were more objective and more nig 
dependent of the rater, i.e., verbal descript!© 
of the behavior of other people. Presuma a 
these ratings could still be affected by a pre 
tive mechanism, but it seems likely that a 
what less ego-involving stimuli would encou 
age greater interjudge agreement [1]; ed 
would predict that naive or inexper se 
judges would show a steeper gradient of os 
creasing rater reliability with lengthened sC# 
if even more objective stimuli were rated. 


A Summary t 

Raters (N= 208) judged the adjust 

level shown in each of ten short case histor i 
Four rater groups were used: introduct? 
psychology, abnormal psychology, psycho! 
graduate students, and a group of post-Pb. 


| 
| 
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clinical psychologists. Rating scales with 3, 5, 
»or 9 Categories were used. Results indicated 
oo increase in reliability with higher 
S ae levels. Rater reliability increased 
arply with longer scales for the introductory 
a ep increased at a slower rate for the 
ie ia psychology group. Factor analysis of 
ea par esa among the groups indi- 
a at a factor related to the length of the 
Loe counted for 91 per cent of group vari- 
iene a second factor reflecting experience 
nces measured 5 per cent of the variance. 


Received August 17, 1953. 
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Personality Correlates of 
Undergraduate Field of Specialization 


Richard C. Teevan 


University of Michigan 


This paper attempts to investigate whether 
or not the personality of an individual is cor- 
related significantly with his choice of major 
field in college. In recent years there have been 
two research programs which stimulated the 
present work: the survey of scientists by Knapp 
and Goodrich [4] and the investigations of 
eminent scientists by Roe [5, 6]. These studies 
attempted to explore the personalities and 
backgrounds of men who are presently working 
in the sciences. 

Since the above investigations, among others, 
have shown that there is a correlation between 

ersonality and vocation, the question arises 

hether this correlation can be demonstrated 
before the vocation is actually entered or 
whether the vocation itself fits the personali- 
ties of its members into a common mold. The 
Present paper throws light on this matter by 
using college students who have already ex- 
pressed their preference for a major field but 
who have not been in that field lon 
for it to affect their Personalities, 
that choice of a major in col 
sarily followed by a similar vocation is a draw- 
back, but one that might serve only to attenu- 
ate any obtained relationships. 


g enough 
The fact 
lege is not neces- 


Procedure 


The diagnostic instrument in this study was 
the Blacky Pictures [2], a modified Projective 
technique measuring psychosexual develop“ 
ment. Eighty-five: male students from Wes- 
leyan University, ranging in age from 17 to 
25 years, were tested. The subjects were chosen 
by their major field, with approximately the 
same number from eacheof the academic divi- 
sions. The major fields were broken down into 


1This paper is abstracted from an honors thesis 
done at Wesleyan University under the guidance 
of Professor Robert H. Kapp. 


three divisions: 1. music, art, German, French, 
and English (N = 29) ; 2, government, eco 
nomics, and history (N = 28) ; and 3. geology» 
astronomy, biology, physics, and chemistry 
(N = 28). An attempt was made to obtain 
subjects who were sincerely interested in their 
field of endeavor, so that an average of B- 
was taken as the criterion. i 
The Blacky Pictures were administered hs 
three sections, each section, insofar as possible 
containing equal numbers of subjects sie 
each division. There were two deviations fro s 
standard procedure: (a) Up to 15 secon? 
longer than the standard two minutes were ĉ x 
lowed on the spontaneous stories; (4) the ie 
quiry questions, rather than being flashed he 
the screen one at a time with a time limit o 
each question, were printed at the bottom to 
each page. Subjects were instructed not a 
glance at them until told to. An observan te 
check and questioning at the end of the ses js 
showed good observance of these instructio 


Results and Discussion 


ized 
The findings of this study are summar; - 
in Tables 1 and 2. Table 1 gives the sig 


n 
= sicions whe 
“cance of the differences between divisions W°, 


Blacky disturbance scores are related to ST 
of major field. In Table 2 the percen tae re 
each group showing disturbed and nee ond 
Sponses are given for those Blacky wee . 
on which significant differences were obtai es) 
The first division (English, art, ag ji- 
was foune to be the highest of the thre ma 
visions on Oral Eroticism. Since the men ) 
jority of the subjects tested (22 out ° per- 
were from the English department, it meget 
haps possible to treat them as literary Sa 
Bergler [1] observed 36 writers in pn rites 
alytic treatment and concluded that all w 
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Personality Correlates of Undergraduate Specialization 


Table 1 


git Relationship between Blacky Scores 
isturbance and Choice of Major Field 


Ranking of division by 
degree of disturbance 


Blacky “Most Middle Least 
fo) y category b Most Middle Least 
a Eroticism -01 1 2 3 
ral Sadism .05 2 1 3 
aa Expulsiveness NS 
n Retentiveness NS 
e ipal Intensity «06 2 1 s 
asturbation Guilt NS 
astration Anxiety NS 
pa eation Process NS 
Gut Rivalry NS 
Feelings 
s 0 
Ego Ideal Ns 
ATCissistic 
ve Obj 
ject 
Anaclitic 
ve Object .07 2 is 13 
Not, i F En 
uA ote. — Divisi > 
ich; Division oe 1—music, art, German, French, Eng- 
ate, 2—government, economics, history; Divis- 
Zy, astronomy, biology, physics, chemistry. 


Table 2 
ina Teentage of Eath Division 
g Disturbed (+) and Neutral (0) 
esponses to Blacky Dimensions 


Show 


Nias Division 
y dimension 1 2 $ 
Lit. Soc. Sci. 
aa Eroticism 2 bas 
eee’ (+) 61 31 18 
Oedipal (0) "39 69 82 
Fie Intensity i 
Neutral a 4 +) 57 66 36 
aI Sadism 43 34 64 
Sea AH 46 55 18 
ilt pe (0) 54 45 62 
m Feelings 
Monet fh 64 86 39 
Naclit: 61 
ae Love Object 36 14 
Sine (F) 11 31 11 
ral (0) 39 69 cs 39 
are 


the pi chic masochists and therefore fixated at 
Blaci a erotic level. Boyd [3], using the 

Thane ictures on children, found more dis- 
than in € at the oral erotic level in good readers 
Ings retarded readers. Thus the present find- 
Wi rom the Blacky Pictures are consistent 
Previous descriptions of literary people 


Da: 
‘sive and dependent. 
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The second division (economics, govern- 
ment, and history) was highest on the other 
four categories that showed differences: Oral 
Sadism, Oedipal Intensity, Guilt Feelings, and 
Anaclitic Love Object. Three of these cate- 
gories contain a common element — emphasis 
on the mother. Thus Oral Sadism is related to 
aggression toward the mother (see Blacky Pic- 
ture No. 2) ; Oedipal Intensity indicates an un- 
resolved conflict over desire for the mother; 
and Anaclitic Love Object reflects a desire 
for the mother as a love object. Guilt Feelings, 
the fourth dimension on which the second di- 
vision is highest, is based on the introjection of 
parental standards and also conceivably fits in- 
to this pattern. Thus the disturbances preva- 
lent in Division 2 tend to center around the 
boy's relationship to his mother. Any interpre- 
of findings is sufficiently spec- 
ulative to allow the reader the freedom of his 
own projections in this regard. The facts 
themselves, however, seem quite clear. 

‘Another striking point is the fact that Di- 
vision 3 (the sciences) has the lowest disturb- 


ance scores on most of the Blacky categories: 
uncovered to accoun 


Since no artifacts can be 

for this finding, we can conclude that college 
students who select a major field within this 
division are less disturbed than those who ma- 
jor in the other fields used in this study. 


tation of this set 


Summary 


This investigation was conducted to deter- 
mine whether or not personality factors are 
correlated with choice of a major field in col- 
lege. Three broad groupings of college majors 
were compared on scores derived from the 
Blacky Pictures [2]. The following significant 
differences were found: 

1. The “literature” division lad higher dis- 
turbance scores on Oral Eroticism than the 
other divisions. 

2. The social sciences division had higher dis- 
turbance scores on Oral Sadism, Oedipal Is- 
tensity, Guilt Feelings, and Anaclitic Love 
Object. 

3. The science division had the lowest dis- 
turbance scores on nearly all categories. 

From the above results it is concluded that 
correlations between personality and vocation 
previously found by Roe [5, 6] for professional 
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groups can also be demonstrated during the 
period preceding entrance into a profession. 
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Congruence of Self and Ideal Self in Relation 
to Personality Adjustment 


Thomas E. Hanlon, Peter R. Hofstaetter, and James P. O'Connor 


The Catholic University of America 


Soa Te of patient change during suc- 
onstrated a hotherapy [4, 6, 7, 8, 9] have dem- 
the ienesa Fate in the correlation between 
Cept as res concept and his ideal self con- 
Pothesis of pe by Roger's Q sort.? The hy- 
Tom this “a present study springs directly 

erapy Scan servation. If successful psycho- 
and inani better adjustment, a positive 
etween ie ntly high correlation should exist 
Btuence of ian of adjustment and the con- 

tord le self concept and the ideal self. 
Tom a po <i should also exist in a sample 
Satisfacto pulation in which departures from 
“noimal adjustment are still within the 
Members aoe that is, in a population whose 
u and b o patients. Studies by Bills eż al. 
Pothesį y Draffen [2] suggest that the hy- 

S will be confirmed. 


Procedure 


S bjects of this study were 78 male 
ela a Catholic iigh school in Wilming- 
3 ware The mean age of the group 
ayan with a range from 14 to 18 
e man standard deviation of .78 years. 

Minist IQ, as measured by the Otis Self- 
teme eting Tests of Mental Ability, In- 
fr ate, Form B, was 104.3 with a range 


om 
Ig, 17 to 140 and a standard deviation of 


, The 
JUniorg 


ton, D 
Was 


Years 3 


Sin 
Periods "he Ss were available for only short 
S eal time, measures of the selt concept 
Ploying self concept were obtained by em- 
“Sort ea mee of the rather lengthy 
nique. The 100 self-referent state- 


S" Yi 
€re presented on one sheet of paper, 


1o 

8 rt 

oi fo Ls fake of brevity, the correlation between 

ae “selfi and ideal self concept will be referred 

Q „Peration eal congruence.” Both concepts of self 
Sorts, ally defined by the results of respective 
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with five categories ranging over the qualita- 
tive scale from “most characteristic” to “least 
characteristic.” After the experimenter (T.E. 
H.) gave appropriate verbal instructions that 
differentiated the two concepts of self, the Ss 
sorted the statements into the five categories, 
first according to their self concept and then ac- 
cording to their ideal self concept. ‘The number 
of statements to be placed in each category 
were 6, 25, 38, 25, and 6, respectively, thus 
forcing the items into a binomial distribution. 

The last step in the testing procedure was 
the administration of the California Test of 
Personality, Secondary Series [10], appropri- 
ate for students from the ninth grade to th 
college level. Two measures of adjustment, 
personal and social, are given by this test. The 
total score may be regarded as an indicator of 
over-all adjustment. 

The self concept and the ideal self concept 
were correlated (Pearsonian r) and the re- 
sulting coefficients were transformed into Fish- 
er’s z to facilitate statistical treatment. The in- 
dividual z values were then correlated with 
the percentile scores obtained from the Cali- 
fornia test. 

The first and the fourth quartiles, each com- 
prising 20 Ss, were compared with respect to 
specific areas and specific items of the Califor- 


nia test. 
Results and Discussion 


The individual correlations between self 
concepts and ideal self concepts ranged from 
—.34 to .79; the corresponding z values were 
from —.35 to 1.07. The mean z was .42 and 
the standard deviation was .26. A comparison 
of the z distribution with the normal curve, by 
the area method, yizlded a x? of 4.89 for 6 df; 
the corresponding p value was higher chan 50. 
Consequently, the distribution of z values can 
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be considered normal. Retransformation into 
Pearson r’s gave a sample*mean of .40. The 
fiducial limits at the .01 level for the mean of 
the universe were .33 and 46, and the lower 
limit of .33 at the .001 level was still signifi- 
cantly greater than zero. It may be concluded 
that the correlations between the self and the 
ideal self were distributed normally around a 
positive mean value.? 

The correlations between self-ideal congru- 
ence (z) and the percentile scores of the Cali- 
fornia test and its subscales are given in Table 


Table 1 


Correlations between Self-Ideal Congruence, 
Adjustment Scores, and Intelligence 


Correlation Mean score 
with High self- Low self- 
self-ideal ideal ideal t 
congruence con- con- 
Variable (z) gruence gruence 
Total adjustment .70* 84.50 34.25 9.29% 
1. Self adjustment .70* 80.50 36.25 6.57% 
A. Self reliance 48* 73.70 47.50 4.09* 
B. Sense of personal a 
worth -50* 80.00 43.30 4.95 
C. Sense of freedom .40* 69.00 36.75 4.78% 
D. Feeling of 
belonging 55* 75.50 40.25 5.65% 
E. Freedom from 
withdrawal 
tendencies .56* 77.00 29.40  6.00* 
F. Freedom from 
nervous 
symptoms 39" 74.50 46.65 3.42%% 
2. Social adjustment „59% 80.25 33.00 7.13* 
A. Social standards .08 70.25 60.05 1.20 
B. Social skills 52° 70.90 30.00 5.59* 
C. Freedom from 
antisocial 
tendencies P .22*** 7545 51.40  2.71** 
D. Family relations .30** 85.75 57.60 3.2443 
E. School relations .45* 65.90 31.50 4,53% 
F. Community 
relations @50* 76.75 27.20 5.33* 
sto) 05 105.80 105.95 0.05 


* Significant at the .001 level. 
** Significant at the .01 level, 
*** Significant at the .05 level. 


2 This statement is also’ tr 
of Pearson r’s, which is negatively skewed, but not 
significantly deviant from normality (x?—= g.34 for 
5 df; p > .10). However, for purposes of averag- 
ing and subsequent correlational analysis, Fisher's 
z’s are preferaLie, 


ue of the distribution 


T. E. Hanlon, P. R. Hofstaetter, dnd J. P. O'Connor 


1, together with the correlation with IQ. ae 
right-hand columns of Table 1 show a com 
parison between two extreme groups pae 
gard to self-ideal congruence, i.e., Ss in mena 
and fourth quartiles of the z distribution. With 
one exception, the correlations between a 
ideal congruence and the adjustment E 
are significant at least at the .05 level. 2 
differences between the means of the two d 
treme groups are also significant. It is nat “i 

prising that the correlation involving 0g 3 
standards” (subscore 2A) is not significan 
for it is indeed doubtful whether mere kno in 
ledge of social standards reflects adjustment 
general or, more specifically, social adjustm¢ 


The F test of linearity [11, p. 278] was ae 
plied to the correlation between self-iden! he 
gruence and total adjustment (.70); ‘all far 
resulting value of .86 was found to fal o 
short of that required for the significan™ 1, 
deviations from rectilinearity at the -05 wee 
ie, an F of 2.14 for 7 df and 69 df. Thus © 
correlation between self-ideal congruence s 
total adjustment is aot only marked but “the 
rectilinear. It is concluded, therefore, that the 
congruence between the self concept a” e 0 
ideal self concept can be used as a measure © 
adjustment with a considerable degree o! hy- 
fidence. This confirmation of the base tifi- 
pothesis of the present study also lends ae 
cation to the manner in which the po f 
school has employed cor-elations between eri 
Sorts in the investigation of the psychot 
peutic process, 


The correlations between IQ and $ 
congruence (.05), IQ and total adjus d1Q 
(-12), IQ and self adjustment (-11), 34 to 
and social adjustment (.11) were all for nes? 
be not significantly different from zero- ean 
findings indicate that self-ideal congruene ence 
adjustment are not a function of intellige? he 
This resúlt is in substantial agreement v a 
findings of Kimber [3], who has reporti a 
correlation of .04 between the Army olleg? 
scores and California test scores of 400 ¢ 
students. 


à fo 
Although there was a slight tendency 


„ideal 
Eat 


o 
zalues 
he r valee or 


3 = a veen t 
The regression equation betwe ile scores () 


self-ideal congruence and the percent 87 Via 
total adjustment (TA) reads: TA a x tisfy tht 
= 17.8. The possible values of r which $3 
equation thus range from —.50 to 1.00. 


ca. - 


— 


Congruence of Self and Ideal Self 


the 
ae Ss to score lower on measures of ad- 
ent and self-ideal congruence, ¢ tests 


showed th igni s was 
at no significar { ionshi 
ad ant relationship wą 


fon ne of the Ss in the first and 
Meal sen art es of the z distribution (self- 
teer g uence) was made on the basis of 
aia ee te to the 180 items of the Califor- 
ii their rh two groups showed no difference 
Nene, Bee = et of responding to 12 of the 
= pened he remaining items, the low self- 
age of oe group have a higher percent- 
ig EE A responses to 155, while the 
Wile: wafer ee = group gave relatively 
atter Da e responses to only 13. In the 
Statistically ce ae of the differences was 
e 155 ite ignificant. On the other hand, of 
centage of oe! which showed a greater per- 
Selfvideal Ai avorable responses for the low 
al congruence group, 42 of the differ- 


ences one 
at ae at the .05 level and 14 


A a 
ens ines analysis of the items that dis- 
that gs in a; eee the fwo groups showed 
ere Piet uous self-ideal congruence group 
Work habits erized by a lack of persistence in 
inadequacy. m by feelings of oppression and 
Ccted by b ia were more likely to feel re- 
to react + oth family and friends and tended 
Selves, ta by withdrawing within them- 
to be mor Is reason, their fantasy life seemed 
ideal co e active that that of the high self- 
and E group. The social standards 
the e pe to avoid antisocial activities were 
self-idea] or both groups, but Ss of the low 
Uneasines congruence group showed much more 
tay in T in social situations. They tended to 
“lling f 5 background and to avoid contacts 
ĉasily E Poise and diplomacy, for they were 
° quarrel and were aware of their proneness 
thei - They tended to dislike school, and 


. ir Miz. 
4 E attitudes made for difficulties 
Students ae with teachers, fellow 

tis Be nd members of the opposite sex. 

sonality. from the above description that the 
Mre lika Y features of psychotherapy patients 
of Ss Y to coincide with the characteristics 
“Self o “lowing a low congruence “between 


Cong 5 
€pt and ideal self concept. 
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Summary 


f The relationship between measures of ad- 
justment and the congruence of the self con- 
cept and ideal self concept in a sample of 78 
high school students was investigated, using 
the California Test of Personality and a modi- 
fied Q-sort technique. The following conclu- 
sions were drawn: 

1. The correlation between the self concept 
and the ideal self concept tends to be positive, 
with a mean value in an unselected population 
between the fiducial limits of .33 and .46. 
Therefore, the over-all tendency is toward a 
congruence of the two concepts of self. 

2. Congruence between self and ideal self 
is a normally distributed trait. 

3. The correlation between self-ideal con- 
gruence and total adjustment is positive and 
highly significant with regression being recti- 
linear. Therefore, the use of measures of self- 
ideal congruence in evaluating the extent of 
personality maladjustment appears justified. 

4. The hypothesis which underlies the use 
of Q sorts in evaluating change in psychother- 
apy is confirmed. Md 

5. Intelligence and age show no significant 
relationship with self-ideal congruence and 
with measures of adjustment. 

6. Maladjustment in a person need not re- 
quire that his self concept be negatively related 
to his ideal self. Where the correlation is min- 
imal (r less than 27), signs of maladjustment 
may already be manifest. 
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Validity of a Critical-Item Scale for 
Schizophrenia on the MMPI’ 


Harold Rubin 


VA Hospital, Lebanon, Pa. 


« i p eg to eliminate the problem of 
En i sine which confronts many clini- 
veloped = the MMPI, Benarick [1] has de- 
tiating epeei scale to aid in differen- 
scale, ve psychotics „from nonpsychotics. The 
sists of poraa earlier in this journal [2], con- 
the MMPI items taken from the Sc scale of 

Eo and scored in the Sc-plus direction. 
of 10 item so presents a second scale consisting 

a ITAA i = iene more frequently in the 
study atte n by nonpsychotics. _The present 
critical items to test the validity of these 
pital sai: scales for schizophrenia on a hos- 

enarick's ation. It differs somewhat from 
chotic re original study in that the nonpsy- 

roup consists of hospitalized subjects. 


Procedure 


M 
= TEDI profiles selected were those of 64 
dministere i of a veterans hospital who were 
Slon test bat the MMPI as part of an admis- 
Breater tha tery, and whose raw Sc score was 
Were ee 20. Thirty-two of the patients 
raw Se so osed as schizophrenics with a mean 
agnose oy of 29.6, and thirty-two were di- 
© score of choreo i with a mean raw 
© Psychiatri .3. All diagnoses were made by 
Period ric staff of the hospital following 
of observation, 


Results and Discussion 


As 
Scores ge be observed in Table 1, the mean 
5 perched eleven-item scale were 3.8 for 
Eee ise and 2.9 for the nonpsychotics, 
+ ANY singl number of critical items obtained 
2 poth gia was eight, this being true 
Ealo 
an Piles Benarick’s [2] suggestion, a cut- 
€ of 4 was used to identify psychotics 


ap 
bang ™ the 
non, pete Veterans Administration Hospital, Le- 


e 
Onsylvania, 


Table 1 


Distributions of Scores of Psychotics and Nonpsy- 
chotics on Two Critical-Item Scales 


Eleven-Item Scale Ten-Item Scale 


Score Psy- Nonpsy- Psy- Nonpsy- 
chotic chotic chotic chotic 
10 

9 1 2 

8 1 1 1 1 

7 2 0 5 7 

6 2 1 7 4 

5 7 5 6 8 

4 7 3 6 5 

3 5 8 2 2 

2 3 6 3 2 a 

1 5 6 1 1 g 

0 0 2 0 0 
Total 32 32 32 32 
Mean 3.8 2.9 5.0 5.3 


il aau 


from nonpsychotics. With this criterion, it 
was found that 59% of the psychotics were 
correctly identified, while 31% of the nonpsy- 
chotics yielded “false positives.” For the total 
group of 64 patients, 629% of the identifica- 
tions made were correct. In an earlier study, 
Rubin [4] has shown that psychotics tend to 
have their highest scores on the Sc scale. On 
this basis, if one were to assume that each pro- 
file represented that of a psychotic, 509% of 
this group of 64 would be correctly identified. 
Benarick’s scale offers a 12% improvement in 
cach correct identifications. 

A chi square computed between psychotics 
and nonpsychotics, using the cutting score of 4 
yielded a value of 5.11, which is significant at 
less than the 5% level. Although not as sig- 
nificant as the findings reported by Benarick 
[2], some validity, it seems, may be attributed 


to this critical-item scale. However, when chi- 


square values were computed -separately for 
t a single item was 


each of the eleven items, no 
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found to differentiate significantly between 
psychotics and nonpsychotics. The distribution 
of scores among the eleven items was markedly 
similar for both groups. One exception was 
that on three of the items (76, 157, and 331) 
the nonpsychotics obtained a slightly greater, al- 
though not significant, frequency. This is in 
contrast to the findings of Benarick, who re- 
ported significant differences between psy- 
chotics and nonpsychotics on the individual 
items as well as on the total scale. 


as observed from 
t the distributions 
psychotics were so 
were unnecessary, 
that among both 
there was a ten- 


the ten-item scale, 
the scales are not 
might expect from Benarick’s results. 


3. Rotter, J. B. Cl 


Harold Rubin 


be statistically meaningful in separating psy- 
chotics from nonpsychotics. Since only four of 
the critical items need be scored to make a dif 
ferential diagnosis or to detect “false poss 
tives,” which, after all, is the purpose of the 
scale, it would seem that the value of the scale 
in differentiating between psychotics and non- 
psychotics is limited, particularly when the 
subjects are hospitalized patients. The present 
study also indicates the difficulty of construct- 
ing a meaningful scale based on psychiatric di- 


agnoses which are themselves of questionable 
reliability [3]. 
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Wechsler-Bellevue Performance of Delinquent 
and Nondelinquent Girls 


Julia R. 


Vane 


Hempstead Public Schools 


and Virginia W. Eisen 


Catholic Charities Guidance Institute 


sete aoe of this study was to determine 
Quents ad of adolescent female delin- 
on the We i i ow a characteristic test pattern 
concerned ae er-Bellevue Scale. Other studies 
ealt with with delinquent patterning have 
a recent st ha offenders, with one exception, 
iee l y by Bernstein and Corsini [4]. 
DSen on investigated the effect of order 
ellevue 5 m of the subtests of the Wechsler- 
dents, TH cale on the scores of female delin- 
Pattern ine that the psychopathic 
e dadin ed by Wechsler is a function of 
“sted was ons under which delinquents are 
a Rie substantiated. They found that 
Same for he er of the subtests was virtually the 
in orde le two groups despite the difference 
r of presentation. 


The . i 
Subjects in the present study included 


of 


an exper: 
ales rrimental group’ of 100 delinquent fe- 
IQs p ctWeen the ages of 16 and 25, with 


clienetween 70 and 110 on the Wechsler- 
e iamen a and a control group of 38 non- 
ange, Al] females in the same age and IQ 
Native p Ss in both groups were white and 
the We et All were interviewed and given 
thors, chsler-Bellevue Scale by one of the au- 


The: expect 
Tents \Petimental group consisted of delin- 
Committed by the New York State 


Courts 
kiti, Non p House of Good Shepherd, Peeks- 
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the age range in which the greatest incidence 
of crime is reported, i.e., 16 to 21 years [8], 
and in this respect should be representative of 
delinquents in general. 

The control group consisted of girls from 
two New York City public high schools. To 
avoid inclusion of possible delinquents, no girl 
was selected who was considered a behavior, 
personality, or social adjustment problem. Tru- 
ancy, even of the shortest duration, was also a 
basis for exclusion, since it had been found 
that 99% of the delinquent group had records” 
of truancy. School guidance cards, attendance 
records, and interviews with the school guid- 
ance counselor, as well as interviews with the 
girls themselves, were used to evaluate the 


variables. 


The nondelinquents were equated as closely as 
with the delinquents for level of intelli- 
gence and chronological age. Years of schooling 
could not be matched since in order to obtain non- 
delinquents similar in age to the delinquents, it was 
necessary to choose the nondelinquents from the 
junior and senior years of high school. As the re- 
sult all the nondelinquents had completed at least 
three years of high school, whereas 91% of the de- 
linquents had left school during the first and second 
years of high school, if not before. Practically all 
of the nondelinquents were enrolled in vocational 
or nonacademic courses. 
‘With respect to socioeconomic background, the 
delinquents and nondelinquents, closely resembled 
one another. The majority of the girls from both 
groups resided in the same areas of New York City, 
and their fathers’ occupations were similar. On the 
Goodenough-Anderson Occupational Rating Scale 
[6] 82% of the fathers’ ogcupations in both the de- 
linquent and the nondelinquent group fell in the 
lower three categories, namely, V—semiskilled, mi- 
nor clerical, minor business, VI—slightly skilled, 
and VII—day laborers. 

The majority of delinquents ( 


possible 


52%) were the 
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children of parents both born in the United States. 
Of the remainder, not more than 10% had parents 
who were born in any one particular country. Half 
of the nondelinquents (50%) also had both parents 
born in the United States. Of the remainder, 26% 
were the offspring of parents one or both of whom 
were born in Italy. No other country was the birth- 
place of more than 8% of the Parents of the non- 
delinquents. 

With respect to intelligence, the mean total IQ 
of the control group showed a slight superiority, but 
the difference was not statistically significant Cc 
1.14). 

The mean chronological age of the delinquents 
(18.5) was 1.2 years greater than the mean age of 
the nondelinquents (17.3). Despite the statistical 
significance of this difference (t= 6.00), it should 
not influence the results since Wechsler grouped 17-, 


18-, and 19-year-olds into one unit in standardizing 
the test. 


Procedure 

Mean verbal 
and mean weig! 
puted for each group, 
mined in terms of th 
, TOW age range and 


fwere equated for le 
peared unnecess 
into Z scores as 
into subtest IQ scores as suggested by Alimena 
[1]. Rather e 

done with both 
useful or of 
weighted subtest scores, 


Results and Discussion 
Table 1 shows 


x 
1 The s n° Glueck and Glueck’s 
Investigation also showed‘, significantly Poorer 


score on Dirit Symbol than the nondelin- 
quents. Glueck and Glueck feel that the Digit 
Symbol test “involves concentration and per- 
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Table 1 


Wechsler-Belleyue Scores of Two Groups 


Delinquents Nondelinquents 


Item (N = 100) (N = 38) 
Mean SD Mean SD t 
CA 18.5 146 17.3 .89 Po 
Weighted score 912 1.10 9.37 1.02 aa 
Full IQ 95.2 840 96.8 6.92 a 
Verbal IQ 93.6 9.72 93.1 7.68 = 
Performance IQ 98.5 10.08 100.9 8.92 ae 
Information 8.43 2.22 9.39 1.97 2 
Comprehension 9.31 217 947 2.19 t 
Digits 8.24 2.42 7.53 1.67 a 
Arithmetic 6.48 2.38 6.61 2.43 f 
Similarities 8.15 2,22 8.08 2.26 oa 
P. Arrangement 10.16 2.42 10.18 2.70 t 
P. Completion 9.64 2.43 9.26 2.17 i 
Block Design 9.70 2.83 9,97 2.13 o0 
Object Assembly 10,86 2.43 11.24 1.87 va 
Digit Symbol 1042 2.55 11.74 143 3 


sistency of effort, and is therefore a test r 
which impulsive, emotionally labile perso i 
would not perform as well as those who 2" 
stable” [5, p. 207]. « he 
© second largest difference between th 
groups was on the Information subtest (¢ ad 
2.46). On this, the nondelinquents were 4 
superior. Although this may be related to E 
fact that our delinquent girls had fewer bee 
of schooling than the nondelinquents, it eum 
be of diagnostic significance. It has been not 
repeatedly by educaters, psychologists, he 
court workers that delinquents rarely wal ce 
capacity in school and consequently experien 
failure and frustration. They often seem by 
try to relieve their feelings of frustration ion 
truancy. The comparatively low Informati 
score of the delinquents seems to be diagnos e 
in that it is a reflection of that aspect © re- 
delinquent personality which operates to P 
vent him from taking advantage of his € 
cationał opportunities. z ts 
On the Digit Span subtest the delinque” 
Were superior to the nondelinquents (¢ 5 
2.03). The difference between the two ery 
is actually due to the fact that the nonde it 
quenis did poorly on this subtest, and not t by 
the delinquents did well. This is indicated e 
the fact that the mean score of the nor iy 
linquents on this test (7.53) is considera 
elow their mean score on the ten mea 
(9.37) and is also considerably below Wee 
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ler’s standardization subtest mean (9.3) for 
this age group. It is difficult to explain this re- 
sult. It is possible that the testing situation was 
TA ae provoking to the nondelinquents 
lh : delinquents and that this anxiety 
el : ower the Digit Span scores of the 
ee ut actually it was not noted that the 
th nquents appeared any more anxious 
ten o delinquents. It is possible that this 
tlt not be considered a valid indicator un- 
urther verification is obtained. 


the Comprehension test there was very 
ee difference between the de- 
a oe aes the nondelinquents, but there 
Fe cara, itative differences. The delinquents 
ene ging to the questions by state- 
What Ich, as “Do you want me to tell you 
cas should do or what I would do?” They 
ee spoiled a good answer to the 
Be ge What is the thing to do if you find 
mark e ape in the street...” by adding a re- 
see if Pia as “I would probably open it to 
i ie ere was any money in it.” Asked “Why 
Bese tall necessary ? several countered with 
ice a me! or to the question why a mar- 
es cense: 15 required they replied “I wish 
meee Several indicated that they would 
= an usher or manager if they were the 
e n to discover a fire while sitting 1n 
alae and then added “I would really 
RER run.” In these replies we see that the 
Ca are aware of the socially accepted 
ee S, although they may fail to apply 
to their own behavior. 

gen the delinquent and nondelinquent 
higher th e Performance IQ was considerably 
ing inet an the Verbal IQ, the difference be- 
istically significant (delinquents, i 

Sad oo nondelinquents, t==4.1). As previous 
iority Tn [4, 5, 7, 9] had considered super- 
ad clin Performance scores over Verbal scores 
one quent or psychopathic sign, the fact that 
>ur nondelinquent group showed this super- 


lorj 
"ity was somewhat unexpected. 
S 
tenn. hypotheses were considered as possible ex- 
Contro] s for this result. One was that because the 
Whose group was more heavily weighted with Ss 
the i ae ea were born in Italy (26%) than is 
uenced ja Population, this factor might haye in- 
tain othe he results. It has been found that on cer- 
ificant] T tests “Italian children tend to rate sig- 
y higher on the performance scale (Arthur 
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Point) than on the Binet” [2, p. 6]. To check this 
hypothesis the scores of the nondelinquents of Italian 
background were compared with the scores of the 
nondelinquent group as a whole. It was found 
that the mean Verbal IQ of the girls with one 
or both parents born in Italy was 91.9, and the 
mean Performance IQ was 99.7. The difference 
between the two scores was 7.8, which is ex- 
actly the difference found between the mean 
Verbal and Performance 1Q’s of the total non- 
delinquent group. In addition, the percentage of 
girls with Italian-born parents whose Performance 
score exceeded their Verbal score by five or more 
points was compared with the percentage of girls 
of non-Italian born parents whose Performance 
score was superior by five or more points. No signi- 
t difference was found. It was therefore felt 
the control group contained a 
large percentage of girls whose parents were born 
in Italy did not account for the result. 

A second hypothesis was that the mean IQ’s of 
both groups in the present study, four to five points 
lower than Wechsler’s standardization mean IQ of 
100, might have had some bearing on the difference 
between Verbal and Performance scores, i.e, that 
lower 1Q groups may normally tend to do better 
on Performance than on the Verbal scale. To check 
this explanation, both the delinquent and nonde- 
linquent groups were divided into two subgroups 
on the basis of high and low IQ. The superiority of, 
Performance score over Verbal score remained sta- 
tistically significant in each case, although the dif- 
ference was somewhat smaller in the higher IQ sub- 
groups. 

A further possibility is that since our two groups 
belonged to a lower socioeconomic level than the 
population in general, this may have influenced the 
results. As we had no nondelinquent group of 
higher economic level, and as figures have not been 
reported from any comparable group, this hypothesis 
cannot be tested at the present time. 


fican 
that the fact that 


The most plausible conclusion seems to be 
that although Performance superiority fre- 
quently has been associated with delinquency, 
actually this may be a characteristic pattern 
of normals at this age level. The fact that 
Wechsler’s standardizing data (9, p. 222] for 
aye levels 16 to 19 years also show a signifi- 
cant superiority (approximately £ = 3.0) of 
Performance scores over Verbal scores would 
appear to substantiate this conclusion. 

It should be noted in addition that two other 
signs associated with delinquency are present 
in our nondelinquent’ group. The sign “Pic- 
ture Arrangement plus Object Assembly great- 
er than Block Design plus Piccure Comple- 
tion” is found in 63% of the delinquent group 
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and 66% of the nondelinquent group, and 
Arithmetic is the lowest ranking of the sub- 
tests in each group. The fact that the three 
above-mentioned signs have been associated 
with delinquents [4, 5, 7, 9] may have arisen 
because the delinquents were not compared 
with a sufficiently similar group of nondelin- 
~ quents. It has been demonstrated that these 
signs are found in delinquent test profiles, but 
our results show that they are not unique for 


delinquents and occur also in certain normal 
groups. 


In general it would seem that the successful 
use of test signs in differential diagnosis varies 
with the circumstances. For instance, it may 
be possible to differentiate delinquents from 
other clinical groups, 
chotics, and organics, 


Wechsler-Bellevue Profiles, but these signs 


erentiate between 
girl and the true 
r that the act of 
a sufficient means 
erience has shown, 
always a good cri- 
ory has girls who 
ly delinquent. Some 
e y punitive families 
single sexual indiscretion. Others 
who ran away from intolerable home con- 
ditions were committed “to keep them out 


of trouble” ; girls of thi 
cluded in our deli 


been committed b 
for a 


s our records in- 
is a highly crucial factor in 


Julia R. Vane and Virginia W. Eisen 


Summary 


A group of delinquent and a control T 
of nondelinquent girls, equated for age T J 
telligence and similar in socioeconomic T 
ground, were given the Wishes a 
telligence Scale to determine if the Aena 
would give a characteristic pattern on ape A 

There was a statistically significant di J 
ence between these two groups on only eo a 
the subtests, viz., Information and Digit Sy n- 
bol, the delinquents being inferior to the = 
delinquents on both. On the whole, the os 
linquents and the nondelinquents were m as 
alike than different, showing similar deviatio 
from Wechsler’s norms for their age pronn 
Three of the signs offered by Wechsler ye 
Levi [7, 9] as characteristic of male Sr 
paths were found in both the delinquents # 
the nondelinquents in the present study. gi 

On the basis of present findings it 1S p 
cluded that female delinquents do show Er 
tain deviations from the standardization ee 
in respect to subtest variation on the Wechs we 
Bellevue Scale. THese deviations cannot, ie 
ever, be considered unique to the delingu o 
since they also appear in nondelinquen s s 
similar age, socioeconomic, and educat! do 
level. One might hypothesize that age, =i ors 
economic, educational, and cultural ni o 
play a larger part in determining sae er yue 
test performance on the Wechsler-Belle 
Scale than do deviant ‘personality factors, 


E > dew 
this hypothesis has yet to be adequately 
onstrated. 


Received October 16, 1953. 
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Note on Sanders and Pacht’s Investigation of 
Size Constancy of Clinica] Groups 


Edward Lovinger 1 


Michigan State College 


In an investigation of perceptual size con- 
stancy of clinical groups, Sanders and Pacht 
[2] employed a rather unusual size-constancy 
index. The Purpose of this note is to point out 
the differences between their index and those 
more commonly utilized and to demonstrate 
how its use is likely to be misleading. 


105 for a group of normals, 99 for a group of 
neurotics, 


The technique they emplo 


Size-constancy index = Sizenear — Sizetay 


Sizenear 


1The author wishes to thank D, 
and Paul D. Greenberg for thes Mi Ray Denny 
gestions. However 


sibility for the 


tively, in order w confo 
erally found in the literature, 


stion 


the obtained ratio, and this result was me 
plied by 100. Thus, perfect constancy EE 
be represented by an index of 100. An in if 
greater than 100 would indicate that the a rd 
parison square selected for the far stan me) 
(four meters) was smaller than the compa o 
son square selected for the near standard Cw 
meters), i.e., that the judged size of the stan! A 
ard was smaller when it was far than when s 
was near. An index of less than 100 would E 
dicate that the judged size of the far standa 
was larger than that of the near. Its 
Although this method of computation Aner 
in an index which ‘clearly indicates the ae 
Parative judged sizes of the standard at to 
two distances, this index is likely to lead nt 
misinterpretations if it is accepted as equivale 
to a Brunswik or Thouless ratio. Sanders y 
Pacht at one point in their discussion The 
have done this, The authors stated: im- 
present results suggest findings which are that 
ilar to those of Thouless |.. , namely, t r- 
Psychotics show less size constancy than wE 
mals” [2, p. 443]. This statement wrt 
not only a seeming misinterpretation of t a 
own data, but also a misunderstandi we sti- 
Thouless’ experiment. Thouless [3] me A 
gated the differences in constancy between ig? 
clothymes and schizothymes. He found no for 
nificant differences between the two groups g 
three different constancy measures, Lae 
all the insignificant differences were in the for 
rection of less constancy (underconstancy), t% 
the schizothymes, Since there was no 1n tic 
tion that’ any of these subjects were psychiot 
including the schizothymes, it would Sa erial 
ther tinwarranted to speak of Thouless’ res tics 
as indicating less size constancy for psych? 
than for normals, + fica 
Tore important, however, is the ale iv- 
that the authors’ constancy index is €q" 
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alent to a Thouless or Brunswik ratio. It 
seems apparent from the statement quoted 
above that Sanders and Pacht are treating the 
mean constancy index of 88 for the psychotics 
as equivalent to Thouless’ ratio, and hence 
they consider their findings similar to those of 
Thouless. It will be shown presently, however, 
that their index of 88 actually indicates over- 
= ae than underconstancy. Hence, 
A ria ts for the psychotics are opposite ra- 
ete similar to Thouless’ findings for 
a4 a he The fact that their results dif- 
af the a of Thouless is not so important 
niie n that their size constancy index 
(100 for ao from perfect constancy 
ion. anders and Pacht and 1.0 for 
ita o f ‘Thouless ratios) which are op- 
aey ra irection from the usual size con- 
boies ex, For example, a Brunswik or 
. ratio of less than 1.0 indicates un- 
omawia A Le, a judgment which falls 
real obj etween retinal proportions and 
object proportions. An index greater than 
uth en overconstancy, Lies a judgment 
ts es eyond real object proportions in a 
s on opposite from retinal proportions. 
é a and Pacht point out that the psy- 
Sbjct on a size judgments go beyond real 
inal ieee pot Enns ina direction away from ret- 
tha ee: ions. Hence, this would indicate 
Sits: ange a constancy index of 88 indi- 
Fitthermare, erconstancy but overconstancy- 
ent when re, this becomes even more appar- 
matches s consider the relative sizes of the 
Taa r the standard at the two distances. 
subject’, stancy would be indicated when a 
of four match for the standard at a distance 
two an Meters is smaller than his match at 
lasa 7 since the size of the retinal 
Mee of an object decreases with distance. 
tg for these matches Sanders and 
sh e formula would have given an index of 
the a 100. When the subject’s judgment 
Neim st ar standard is larger than that for the 
ap andard (overconstancy), the esultant 
ers and Pacht index would be less than 
0. This inverse relation to the Brunsw’k or 
s roules Tatios becomes most apparent when 
examines a hypothetical situation wherein 


our subject’s judgments conform strictly to 
retinal proportions. With Sanders and Pacht’s 
xperimental arrangement, when the standard 
is 50 mm. in size, our subject’s judgments 
would be 125 mm. for the near standard and 
62.5 mm. for the far standard. Such a situa- 
tion would result in Brunswik and ‘Thouless 
ratios of zero, whereas Sanders and Pacht’s in- 
dex would be 150. 

If one does not take into account the dis- 
crepancy between Sanders and Pacht’s con- 
stancy index and Brunswik or Thouless ra-> 
tios, much of their discussion seems confusing 
and appears to contradict their results. For ex- 
ample, they point out that their data indicate 
a breakdown in constancy for schizophrenics 
opposite in direction from that predicted by 
Bruner [1]; ie, the schizophrenics’ judg- 
ments, rather than conforming more with ret- 
inal proportions, go beyond real object propor- 
tions in a direction opposite from retinal pro- 
portions. This statement seems to contradict 
their report of a mean constancy index of 88 
for the psychotic group when this index is ac- 
cepted as equivalent to a Brunswik or Thou- & 
less ratio. However, when the fact that their 
index indicates deviations from perfect con- 
stancy in a direction opposite from Brunswik 
or Thouless ratios is taken into account, then 
the seeming contradiction disappears. 

It is recognized that the usual methods of 
computation would not have given a single 
size-constancy index for the standard at two 
positions, but rather, two indices, one for each 
position of the standard. However, if the au- 
thors desired a single index, they could have 
obtained indices comparable to the usual ones 
simply by altering their equation to read as fol- 
lows: 

Sizerar — Sizenear 


Size-constancy index = 


Sizetar 
Just as for their equation, a constant of one 
should be added. s 

One wonders why, in the interest of con- À 
sistency with previous research in this area, 
the authors chose an index not equivalent to 
those commonly used. 
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Books 


Bach, Geor i 
ge R. Intensive group psychotherapy- 
New York: Ronald, 1954. Pp. xi AS. ce 


i ae Psychotherapy attempts a mar- 
nati, Ae therapy and Kurt Lewin’s group dy- 
Gom T on two continuous intensive therapy 
bierez 2 eang interspersed with protocols and 
nick fe + rom the therapy sessions, the volume 
vohred if the ormiflations of the many factors in- 
that, ten group therapy process. Its weakness is 
ing the dere it is overorganized, possibly giv- 
tetany” ean i n group therapy the feeling that 
krere An A e done by rule of thumb methods. 
Seclusion 5 or example, 4 personality criteria for 
7 therapeutic fare no less, 16 communication themes, 
“theragnosti uneia in role playing, 7 phases of 
velopmer y work,” 18 do’s and 10 don’ts, 7 de- 
Wigan pane, 7 communicational levels, 7 in- 
group dyna lefensive resistance, and 8 factors of 
zation, eee In spite of the mechanistic organi- 
otk ce Te ume is one of the most intriguing 
Ba ea e therapy to appear in some time. It 
T rop: to bring order out of chaos, even 
thor’s axi gidly structural. If one accepts the au- 
ioms, the conclusions follow logically. —M.K. 


Christi i 
a Richard, & Jahoda, Marie. (Eds.) Studies 
Scope and method of “The authoritarian 


ber. ity” 
a, aie Glencoe, Ill.: Free Press, 1954. Pp- 


oe 
Rite ee volume, seven authors make a 
Sonality ie anon of The Authoritarian Per- 
its methods 50) by examining some of its concepts, 
Shils and — the subsequent studies it inspired. 
the study’ aswell contribute cssays that deal with 
a th ys structure of concepts and theory. In per- 
tezes most telling chapter, Hyman and Sheatsley 
Pling paia Nels of method with respect to sam- 
ysis. Ch easuring instruments, and methods of anal- 
One ater reviews the newer research studies. 
tique ak point that emerges both from the cri- 
Sorp from subsequent research is th need to 
thorit education and social class in studies of au- 
lat arianism. Some of the -attributes and corre- 
es of the trait now seem to be identified as social 


M Note.—The reviews were prepared by the Editor 
ae the Associate Editors, who may be identified 
y their initials. 


class differences. In a concluding section, Frenkel- 
Brunswik reviews the study from the viewpoint 
of an original contributor, and reports new data 
from an investigation of children’s prejudices. This 
critical volume gives a global impression that The 
Authoritarian Personality possessed many faults of 
method and hence of conclusions, but that it opened 
to investigation a significant area hitherto domi- 
nated by opinion and controversy.—L. F. S. 


Eissler, Ruth S., et al, (Eds.) The psychoanalytic 
study of the child. Vol. VIII. New York: Inter- 
national Universities Press, 1953. Pp. 412. $7.50. 


This eighth volume of a now well-established 
series is up to the excellent standard of previous vol- 
umes. The nonanalytic child psychologist should 
not be frightened by its theoretical orientation, as 
the case material is extensive and worth reading in 
its own right. The result is a mature and stimulat- 
ing symposium.—//’. A. H. c 
Eysenck, H. J. Uses and abuses of psychology. Lon- 

don & Baltimore: Penguin Books, 1953. Pp. 318 

(paper). 65¢. 

In this smoothly and interestingly written non- 
technical book, Eysenck discu-ses intelligence testing, 
vocational psychology, abnormal behavior, and social 
attitudes. As might be predicted from his other 
writings, the author emphasizes the findings from 
research and takes a dim view of intuitive apprais- 
als, psychoanalytic theory, and psychotherapy in 
general.—L. F. S. 


Hartley, Eugene L, (Ed.) Doubleday papers in psy- 
chology. Garden City, N. Y.: Doubleday, 1954. 
Leuba, Clarence. The natural man. Doubleday 
Papers in Psychology, No. 1, 1954. Pp. x + 70 

(paper). 95¢. 

English, Horace B. The historical roots of learning 
theory. Doubleday Papers in Psychology, No. 2, 
1954. Pp. viii + 21 (paper). 65¢. 

Frank, Lawrence K. Feelings and emotions. Double- 
day Papers in Psychology, No. 3, 1954. Pp. viii 
+ 38 (paper). 85¢. 


These three pamphle‘s are the first of an an- 
nounced series of fourteen papers on psychological 
topics. As judged from the inital sample, the 
pamphlets are clear, elementary, interesting, and at- 
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tractive. An assembly of appropriate topics might 
provide text or reference material for a course in in- 
troductory psychology or for extension courses. The 
Pamphlets would not be suitable for advanced or 
graduate instruction. Leuba’s The Natural Man, an 
excellently integrated presentation of studies of 
chimpanzees and of nonliterate cultures, provides a 
novel introduction to the problems of psychology. 
English, in the second pamphlet, reviews theories of 
learning from Descartes and Hobbes to E. L. Thorn- 
dike. Frank’s essay, Feelings and Emotions, is some- 
what more diffuse and “popular” than the other two 
papers. It cites no references, ignores many issues 
that most psychologists would regard as relevant to 
its topic, and digresses into the areas of child de- 
velopment and personal adjustment.—L, F. S. 


Ingham, Harrington V., & Love, Leonore R. The 
process of psychotherapy. New York: McGraw- 
Hill, 1954. Pp. ix + 270. $5.00. 

This is a descri 
chotherapist works, with no attempt to introduce dy- 
namics of personali 
derstand treatment procedure, 


Libo, Lester M. Measuring group cohesiveness. Ann 
arbon Mich.: Univer, of Michigan Press, 1953, 
P. ix + 111 (paper). $2.00. 


a report of research 
V projective test for 
to group. The test shows ex- 
ility and signi 


use, not as a 
» F. S. 
Klopfer, Bruno, Ainsworth, M: 

i ary D, 

ter G., & Holt, Robert R. De oo g's 

Rorschach tech 


d ‘velopments in the 
mque. Vol. I. Techni u 

ory. Yonkers, N, Y.: World i, tek ee 
igs” ie orld Book Co., 1954, Pp. 


Replacing the widel 
nique, by Klopfer and Keliey, 


: z e is 
once a manual of administration, Scoring, and int = 
pretation, and a theoretical mon í s 


to bring the Rorschach -est w 


New Books and Tests 


contemporary theories of personality. peabubly a 
great majority of clinical psychologists wat ian 
something of interest and value here, a situati S 
which attests at once to the book’s comprehensiveness 
and to the depths to which the Rorschach has oe 
etrated the clinical culture. One anticipates that t g 
same kind of comment will be in order when a wail 
ceeding volume, Fields of A pplication, is publis res 
In its role of manual, Technique and Theory ny - 
sents a considerable advance over the older m 
fer and Kelley. There is much more detaile tion 
tention to scoring problems and to the clarificat! is 
of scoring principles. The matter of interpréta" on% 
discussed with thoroughness, and with a area 
degree of awareness than before that there are Hi 
portant validation problems still unsolved. 5 
couching of interpretative assertions in the form in 
hypotheses may represent a decided gawane the 
thinking about the place of the Rorschach i 
clinician’s tool kit, at once warning against dog rel 
tism and providing an impetus for serious ea tie 
on the instrument’s actual utility. This part © mes 
book is informative, teachable, and most eel 
The three chapters comprising the near t 
monograph” are stimulating, if a bit uneven. F er- 
chapter on the implications of contemporary y 
sonality theories for a Rorschach rationale 1$ n 
ceptionally able and constitutes the most serious T 
Sophisticated effort to-date to relate the test to per 
and potentially testable issues in theoretical p 
chology, One senses a degree of defensiveness 10 
Ainsworth’s discussion of validation problems, 
she has done a fair, intelligent, and thorough F te 
uation of the voluminous literature, and her chen 
will be invaluable as a source of information. g 
Klopfer’s concern with Rorschach hypotheses a 
ego psychology is essentially speculative and Ka 
to too certain interpretative assertions. (“The mix 
liest communicated response to shading shows 3 ably 
ture of cF and Fe. This represents a consider ess” 
differentiated need for affection and belonging” e- 
P. 590.) But read with an eye both to clinically out 
ful insights and to the formation of hypotheses a this 
Rorschach and about personality functioning iy J 
vigorous chapter is challenging and every e 
There can be no gainsaying the importance sont 
book at this Particular stage of clinical psycho end 
development. The judgment of history will H it 
on the quality and outcome of the research t 
should {uimulate.—E.J.S, 
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Paterson, Donald G., Gerken, C. d‘A., 
Milton‘ E. Revised Minnesota Occupational 
Scales, Minneapolis: Univer. of Minnesota 
1953. Pp. ix + 85 (paper). $2.00. ‘a 
This 85-page pamphlet is a second revision ee 

Minnesota Occupational Rating Scales, first oa tl 

In 1937. The scales consist of ratings, based 2 

Pooled judgment of vocational psychologists, sof 

seven abilities or aptitudes as these are require 


SS =a 


| 


ia 
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paok of 432 occupations. The abilities, each rated at 
ar levels, are academic ability, mechanical ability, 
ocial intelligence, clerical ability, musical talent, 
pone ability, and physical agility (new in this 
fe ie TE variation in the ratings from scale 
For ieee H an occupational pattern, €g. ratings 
ratings sa aà are ADA B D D D. These 
A R pacer in a table in which jobs are 
fying Sets abetically, each preceded by an identi- 
Beene ne and followed by the D.O.T. code 
a Sdieri pE at every level of each ability, and 
Pra pre cation that makes easy a considera- 
AOA ithe one alternatives. Uses of the scales 
By this Veer ual Counseling Record are explained. 
rated em, both the counselee and the job are 
in the same terms.—A. R. 


Tyl 
on tee cee work of the counselor. New 
5 eton-Ce: inl = < F 
323. $3.00. entury-Crofts, 1953. Pp. xi + 


ay an y a text for a first course in coun- 
mate af nia or conceives counseling as “more a 
what one sa at see perceives or comprehends, than 
most eireas does,” and emphasizes this position 
Practical iate in the context of discussing such 
pational PE as the use of records, tests, or occu- 
seling is still ation. Because she admits that “coun- 
argely in te to a large extene an art,” she writes 
Periences,” a wisdom based on “shared ex- 
ter includes a uding her own. However, each chap- 
vant research poe summary evaluating the rele- 
Voted to a a ence, and the final chapter is de- 
the outcomes Re a, of studies on the evaluation of 
date bibliogra Te at Included is an up-to- 
as an nae hy of 175 titles. Although designed 
e read with ory text, this little volume might well 
deals with eee by experienced counselors. It 
that this revie ic issues and treats them in a manner 
ble. The styl ‘ihe found both challenging and sensi- 
yle of writing is superior—E. L. K. 


Witki 
an = An Lewis, H. B., Hertzman, M., Mach- 
sonalit +, Meissner, P. Bretnall, & Wapner, S. Per- 
1954, T through perception. New York: Harper, 
. Pp. xxvi 4 571. $7.50 


aut and his collaborators here report one of 
theory, i best achievements in the integration of 
variable 1¢ laboratory, and the clinic. The major 
orientati in their elaborate ten-year study is space 
cate th ion—the tendency of the subject to “s+ : lo- 
field oF with reference 10 se the axes of the visual 
body. with reference to sensations from his own 
relation { Tests of space orientation are studied in 
motor 4 to one another, to ther perceptual „and 
clude osts, and to clinical appraisals, which in- 
Drawi an interview, the Rorschach, the Figure- 
stude: ing Test, and the TAT. Subjects are college 
pe a of both sexes, children from 8 to 17, and 
to al hospital patients. In the main, the data seem 

confirm the hypotheses that “field dependence” in 
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the perception of the vertical is a consistent variable, 
and that it has meaningful relationships to other 
features of the organization of personality. The 
studies of sex differences, and of the curvilinear rela- 
tionships of certain perceptual variables with age 
from 8 years to adulthood, are especially penetrat- 
ing. The methods for treating the data of the inter- 
views and projective tests, achieving quantification 
without undue loss of clinical insights, may serve as 
models for future studies. Amid all these real mer- 
its, the work has one serious shortcoming. The in- 
terviews and projective devices were analyzed a 
posteriori by examining the performances of groups 
already identified as different in their space per- 
ceptions. The research with the personality tests 
is therefore exploratory and suffers from the classic 
error of discovering hypotheses and testing hy- 
potheses with the same group of subjects. Cross val- 
idation is not entirely absent, but is weak and in- 
sufficiently stressed; procedures had to be modified 
for the children and for the patients in such a way 
as to leave indeterminate the extent to which the 
findings are due to the changed procedures, to the 
character of the samples, or to statistical shrinkage. 
The one genuine cross-validation group (p. 461) is 
small and incompletely reported. These faults can, 
and almost surely will, be remedied by further re- 
search studies. On the whole, the coordinated re- 
search program has great value, and the report 
should command the attention of all psychologists A 
from the purest experimentalist to the most practice- ~ 
centered clinician—L. F. S. 
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Flanagan, John C. Flanagan Aptitude Classifica- 
tion Tests. Battery of 14 tests: Inspection, Coding, 
Memory, Precision, Assembly, Scales, Coordina- 
tion, Judgment and Comprehension, Arithmetic, 
Patterns, Components, Tables, Mechanics, Expres- 
sion. Grade 12-adult. 1 form (2 forms of 8 tests). 
3 (5) — 35 (40) min. per test, (6) hrs. for bat- 
tery. Test booklets ($3.20 per 25, each) ; aptitude 
classification sheet (70¢ per 25); personnel di- 
rector’s booklet, pp. 27 (50¢) 5 counselor’s book- 
let, pp. 35 (40¢) ; technical supplement, pp. 16 
(40¢) ; student’s booklet, pp. 20 (25¢) ; examiner’s 
manual, pp. 27 (30¢) ; specimen sets ($3.00- 
$3.75). Chicago: Science Research Associates, 1953, 
1954. 


The impressive Flanagan test battery is a product 
of studies that began in 1946 and are still continuing. 
The 14 tests were devised to measure job elements 
based on analyses of the critical behaviors required” 
in a number of occupations. For personnel selection 
and classification, selected batteries of tests may be 
administered, as recommended for the job or jobs 
to be filled. For vocational guidance, the entire six- 
hour battery may be used to obtain composite ‘scores 
representing 30 occupations. The technical quality 
of the tests is excellent. Items have been invented in- 
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geniously and are contained in well-planned book- 
lets, most of which are arranged for easy self-scor- 
ing with carbon inserts. The reliabilities of the test 
elements range from about -55 to .85, but the relia- 
bilities of the composite scores for occupations, 
based on 2 to 7 subtests, are from .83 to .93. Test 
intercorrelations are generally low, with an average 
of .29 and only a few coefficients aboye -50. Norms, 
based on 1,563 Pittsburgh high school seniors, are 
expressed as stanines (single-digit standard scores) 
and as percentiles, Validity for occupational predic- 
tion is discussed in terms of a four-year follow-up 
study of high school students who entered seven oc- 
cupations; raw correlations with criteria of voca- 
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In their most useful application, projective 
techniques are not concentrated estimates of 
oe lenges They are not even multiscore 
i 5 ey permit extremely complex, un- 

eps behavior. The number and selection 
ene are so little controlled that the be- 
or cannot conceivably be represented by | 
Smt each ultimate factor separately. 
oe like Cronbach [6] have attempted 
io the mathematical complexity in- 
thar ae angmuir [16], the physicist, has stated 
plenom, muse face the concept of “divergent 
ee a ena,” events so coniplexly determined 
Tamen, a study them at all within the 
usta ork of classical science. He feels we 
štead ea the limits of science, and in- 
1 of science use common sense, judgment, 
and intuition. 
tae aaa present time, clinical psychologists 
Rl seta They describe and predict 
Tor this endencies in che field of personality. 
ane inact they may use projective tech- 
samples pines and particularly meaningful 
of the S of individual behavior. The true value 
1 se procedures is not represented in a sin- 
&le score or in a series of scores. 

The reliability and validity ofsuch techniques 
are not readily demonstrated. However, if 
Psychologists can be persuaded to make limited 
judgments based on these techniques, the judg- 
ments can be tested for reliability and for val- 
idity. To a degree we can check the usefulness 
and accuracy of the procedures involved. In do- 
Ing so, we follow the common procedure of 
science: from something extremely complex we 
tease out something simple enough to deal with 
objectively. 

The studies of judgment with projective 
Material have, so far, been somewhat disap- 
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pointing. The reports on projective techniques 
in Kelly and Fiske’s Michigan study of embryo 
psychologists [14], the Air Force studies using 
the Rorschach [20], the generally excellent 
California Institute of Child Welfare study of 
judgments of adjustment in a group of adoles- 
cent subjects [8], Kurtz’s carefully fair use of 
the Rorschach in attempting to select insurance 
company personnel [15], and other similar 
studies have left the impression with both op- 
ponents and friends of projective techniques 
that such studies have so far shown zero or 
close to zero correlation between judgments. 
based on projective techniques and any accept- " 
ably established outside criterion. 


Purpose 


The present discussion is limited chiefly to 
10 studies, which used either so-called Ror- 
schach signs, or judgments based on projective 
and clinical material. Five of these studies 
yielded positive results, and five failed to do so. 
The positive results were not entirely discour- 
aging, and the negative results may be due to 
specific details of method. A consideration of 
these studies suggests that many factors con- 
tribute to positive or negative results. Chiefly 
for purposes of emphasis, however. one factor 
may be singled out for comment and stated in 
the form of a hypothesis. 

“Hypothesis: Positive and negative results in 
these studies are directly releted to the sim- 
plicity or complexity of the material judged, and 
to the adequacy of the experimental conditions 
in enabling the clinician to derive judgments 
from the degree of complexity presented. Sub- 
hypothesis 1: In general, negative results may 
be-expected when the units of material judged 
are too simple or atomistic. Sukhypothesis 2: 
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In general, negative results may be expected 
when the units of material judged are too com- 
plex to be manageable within the conditions 
of the experiment. 

It is probably apparent that the general the- 
sis offered here is in some opposition, at least, 
to the use of so-called Rorschach signs and, on 
the other hand, to uncritical emphasis of glo- 
bal units or macrounits in clinical research. 


This opposition may be more apparent than 
real. 


The Studies 


The 10 studies considered were carried out 
by staff and graduate students associated with 
the University of Pittsburgh and with the Vet- 
erans Administration in the Pittsburgh area. 
Of these studies, four used Rorschach signs 
and six used judgments by clinicians. The stud- 
ies have been reported elsewhere [1, 2, e A 
10, 11, 13, 18, 19, 21], and the two least avail- 
able [13, 19] have been summarized by New- 
ton [18]. Three other references to the 

[3, 9, 12] are listed at the 
Briefly, the 10 studies ma 
Hollows: 


1. Hamlin, Albee, 


series 
end of this article, 
y be identified as 


and Leland [10 compar- 
ed Muench’s Rorschach signs a A iio 
divided into three groups of socially adjusted 
subjects, maladjusted subjects, and neuropsy- 
chiatric Patients. The sign scores failed to dis- 
tinguish between the groups. 


2. Hamlin, Berger, and Cummings [11] 
compared Muench’s Rorschach signs for 20 


3. Basic R 
subjects [11] 
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ter adjusted than schizophrenics. From Pa 
data, Bendig has derived a correlation o e 
significant at the .01 level of confidence betw 
judgments and criterion groups. m. 
6. Bialick [4, 5] used a paired- compat ia 
method to develop a similar scale of inteli 
judged only from five Rorschach X, or Yl 
responses for each subject. In details of met ve 
this study is the most interesting of the a 
For a small sample of 25 subjects, oe 
and Wechsler-Bellevue IQ correlated .68; 
nificant at the .01 level of confidence. at 
7. Cummings [7] developed 10 scales ith 
justment, one for each Rorschach card. a 
50 cases, the 10 combined judgments on San 
subject correlated .50 with an outside crite 
of adjustment. 


sst 
8. Newton [18] developed a scale of ara 
ment judged from total Rorschachs. Wi how 
cases, the Rorschach judgments failed oe tt 
a significant correlation with an outside, rs an 
ion identical with Cummings’, and wit 
other outside criterion. d tw? 
9. Hamlin and Newton [13] presente inaf 
Rorschachs from Newton’s study to a ion 
for “blind” analysis. In Newton’s pre tex 
study, the two Rorschachs had been rated i al 
actly the same level of good adjustment, iy 
though one subject was known to be poa an! 
well adjusted and the other was psychotic ects 
markedly maladjusted in nearly every resp the 
No other basis was considered in selena te 
subjects. After careful study of the Ro aie 
only, each of the eight members of the pject 
nar rated as less well adjusted the ting 
known to be so, and the average group ent 08 
of the degree of difference in adjust nably 
Newton’s seven-point scale was “reas? 
accurate.” udg? 


10. Whitmyre [21] had psychologists Jis 
adjustment from drawings, and art por 
Judge"che same drawings for artistic pon a 
Each judge sorted and ranked 50 aav scale 
a single task, and an illustrated judgmen esult 
Was not used. The implications of the ‘mest 
ing high correlation (.78) between adjus ered 
values and art values will not be or ene 
in this paper. However, an incidental V ment? 
Correlation between psychologists’ juden o 
of cases and an outside criterion of adjus 
Was essentially negative. 


t 


The Clinician as Judge: Implications of Studies 


Complexity of Units 


The main thesis of this paper is related to 
the complexity of units judged. A rough con- 
tinuum may be set up for the simplicity or 
complexity of the material: 

_ L. Rorschach signs or other scored or judged 
Single units that represent only small fragments 
ys the projective material, mechanically select- 
ed. 

| 2. Figure drawings or parts of the Rorschach 
a selected on the basis of some rationale and 
retaining some degree of organization or con- 


figurational meaningfulness, some degree of 
complexity. 


| 3: Total Rorschachs or units of similar 
complexity. 

These three levels of units are illustrated 
by the studies of Newton [18], Cummings 
[7], Newton and Goodman [19], and Hamlin 
and Newton [13]. Newton used total Ror- 
schachs, Cummings used single Rorschach 
cards, Newton and Goodman used Rorschach 
EN and Hamlin and Newton presented two 
E aa 50 cases for blind analysis to a 
a x here the protocols could be studied 
Pit S y and carefully. These four studies 
Saa ony momgarable h. tie Jalana 
T edhe , in the outside criterion, in the kind 
ra ig used, and in the proj ective technique 
| ig The four studies differed in the 
oe a and complexity of the units judged, 

| k e comparable conditions provided for 
making the judgments? 

Using Rorschach signs applied to Newton’s 
50 cases, Newton and Goodman found no 
Significant relation with the relatively ade- 
quate outside criterion. The signs selected for 


this study were Buhler’s Basic Rorschach 
core, 


With 10 different scales, one for each Ror- 
schach card, and 10 separate judgments, one 
foreach car d, Cummings’ resulting correlation 
of .50 was significant at the .01 level of con- 
fidence. The units judged were not too complex 
for the conditions of judgment. 

However, when Newton used total Ror- 
schachs as the basis of judgment, with entirely 
\ Comparable subjects, judges, and outside cri- 

terion, no significant validity correlation was 
found. This result seems contrary to the idea 
that global judgments are more meaningful 


al 
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than judgments based on somewhat smaller 
units. However, the contradiction is not nec- 
essarily a real one. The one important factor 
that may be stressed is that the judging pro- 
cedure broke down. The seven-point judg- 
ment scale was illustrated by a Rorschach at 
each point on the scale. These sample illustra- 
tions were too complex to be useful. No one 
judge rated more than 15 Rorschachs, and the 
judges spent ample time and effort on these. 
However, increasing complexity beyond a cer- 
tain point probably does not lead to meaningful 
global understanding, except under ideal con- 
ditions or in a clinical situation where data 
can be cross-checked, discarded as not perti- 
nent, or synthesized in a manner that eventually 
results in a simplified picture derived from 
complexity. 

Stated in a crude way, the judgment process 
should be about as complex as the material 
judged and as the judgment required. For ex- 
ample, our seminar study of two of Newton’s 
cases at least suggests that complex units of 
projective material, in thiscase total Rorschachs, 
can be used successfully in making judg- > 
ments. These two Rorschachs had been rated\y 
at exactly the same level of adjustment by 
Newton’s judges. However, under seminar 
conditions, every member of the seminar rat- 
ed as better adjusted the subject so identified 
by the outside criterion, diagnosis, and over-all 
clinical picture. 

In general, the results of all 10 studies may 
be interpreted as supporting the main thesis: 
Small, mechanically scored or judged units 
tend to give negative results. The likelihood of 
positive results is increased by larger units, by 
samples of behavior that are sufficient to rep- 
resent some degree of organization, so that a 
clinical judgment—rather than a mechanical 
scoring without a rationale—is possible. How- 
ever, the global unit, or macrounit, will give 
negative results unless the conditions for judg- 
ing are complex, time-consuming, and approach 
actual clinical procedures. Briefly, the stud- 
ies may be grouped in terms of unit size and 
judgment conditions: 

Atomistic units. Of the four studies with Ror- 
schach signs [10, 11, 19], three gave negative 
results. The one statistically significant result 
was probably due to an unusually good outside 
criterion. 
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Simple configurations. All three studies in 
which a judgment scale was established first 
and then applied to units smaller than global 
Rorschachs [1, 2, 4, 5, 7] gave results signifi- 
cant at the .01 level of confidence. Judgments 
of drawings correlated .47 with adjustment ; 
judgments of single Rorschach cards correlat- 
ed .50 with adjustment; and judgments of five 
W responses correlated .68 with intelligence. 

Complex units. The three remaining studies 


[13, 18, 21] suggest the precautions that must 
be taken if the judge is presented with exten- 
sive, complex material in a single judgment 
task. Judgments of total Rorschachs gave nega- 
tive validity results. Ranking 50 drawings as a 
single task, and without an illustrated judg- 
ment scale, gave negative validity results. Time- 
consuming, intensive analysis of two complete 
Rorschachs did permit correct judgments, but 


in these two cases only and under conditions 
that are impractical fo 


The California 
of Rorschach judgmen 
closely parallels one of 
cedure and negative res 


ments required, 


Other Considerations 
Obviously, 
not the only 
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criterion: psychiatric diagnosis as a measure p: 
adjustment, or a paper-and-pencil test of EE 
thing that happens to be labelled aie. 
We expect clinical “experts” to look at a 
schachs, for a relatively brief time, with m 
terial often dubiously reproduced, and then a 
pick good clinical psychologists with no a 
what a good clinical psychologist is, or in A 
ance sales managers with no rationale an i, 
real clinical experience with these individua 
We tend to expect magic. 


In an area where methodology is ile 
veloped, Cummings’ correlation of 50 “ike 
a dubious outside criterion and an bree ’ 
adjustment, which has hardly been pe hach 
is surprisingly high. Using only live Roarse 1 a 
responses per subject, Bialick obtained ie 
correlation of .68 with Wechsler IQ. atk 
ments on a mere fragment of the kore 
correlate better with the Wechsler than ect- 
the CAVD, the Otis, or several other resP 
able tests of intelligence. ard 

Definition and outside criterion. In weet” 
to defining a variable and in regard to 8> we 
ing and establishing an outside criterion, ita 
should consider the known skills and lim 


$ ! A A ence 
tions of the clinician. Bialick used intellig e 


he 


n» we 
In using the variable “adjustment er 
were on less firm ground. Adjustment ‘de cri 
fined verbally anc in terms of an ans erchi , 
terion. The verbal definitions were sketen 
but in the later studies they tended mo” from 
More t) include such phrases as ‘freedom ntact 
anxiety,” “ability to handle anxiety, = hal- 
with reality,” “capacity for delusions © othe! 
lucinations.” That is, we simply neen upt 
words to parallel our outside criterion g" ight 
normals, neurotics, and psychotics. It recis? 
have been better to describe te Piter 
and repetitive detail what the outside aral 
ion was. The outside criterion closely r the 
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judges. The judges were already acquainted 
with the Rorschach performances of many neu- 
rotic and psychotic patients. 

Material judged. Complexity of units has 
been discussed. One other point might be 
Stressed in regard to material judged. With pro- 
jective techniques especially, an adequate sam- 
ple of material pertinent to the judgment re- 
quired should be assured. 

Bialick’s study may be used for illustration. 
In the Rorschach, the blots and procedure do 
not require the subject to give responses with- 
in the framework of a specific variable to be 
Judged. For this reason, a subject may not pro- 
re a sample of behavior pertinent to a specific 
y oe study. Bialick studied the quality 
a pone B related to intelligence. 
five or mare W, every Rorschach that had 
Tisichats den Rea eo bit discarded any 
Reynolik ür poe! wa W responses. Mc- 
o had Hs i = orm level, ae to R 
selected in advance. The ai ag oe ga . 
search purposes, cor trol veil “aaah pol a 
taas atone ntrols s ould be used to ob- 
A dine late sample of pertinent behavior. 
Bea een paranoid schizophrenic can 
for ited oeras erage by default and 
oaae een a his ability to do so is 1m- 
Wemigh: da bie research purposes, however, 
Commenee te o spe Rorschach sown 
control ea or control sn an 
rections, or “it atios, ae a 
judges are no substit ig Als ane ale 
of behavior, itute for an adequate sample 
oo a guz expectations and plans for a 
reida dy, the clinician judge should ber 
Sets and li = subject, not a magician. His Ae- 
a Imitations should be considered in de- 
io on complexity of task, sample of behav- 

or presented, definition of variable, and selec- 
tion of outside criterion. In addition to his 
background of general experience, he should 
have specific training in definition of variable, 
and should be given a trial run with correction 
of errors and opportunity to review his mis- 
takes. Eventually, the basis of successful judg- 
ments should be thoroughly studied. 

We might assume that the “expertness” of a 
competent clinician consists of a high degree of 
skill in descriptive prediction for subjects and 
variables with which he is extensively and re- 
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cently acquainted in a somewhat limited set- 
ting. A good state hospital psychologist can 
probably say much that is valid and useful a- 
bout state hospital patients. Put him in a cor- 
rectional institution or a clinic for children and 
his predictive validity may be limited for a 
time. Use him as a judge in one of our studies 
and his predictive validity may be limited in- 
deed. His skills may be readily converted or 
transplanted, but this process must be fostered 
and provided for. In this paper, complexity of 
units may illustrate the necessity for studying 
the clinician carefully in setting the judgment 
task. 
Conclusions 

In summary, the present paper has offered 
several suggestions in regard to studies of clin- 
ical judgment applied to projective techniques: 

1. Such judgments are not like traditional 
test scores. In traditional tests, complex mater- 
ial is reduced to mechanical units that are 
counted. With projective techniques, the clin- 
ician may be asked to make an arbitrarily sim- 
plified judgment. Both methods serve to tease, 
out something simple from something complex 
But the methods are not the same. 

2. A number of widely publicized studies 
have produced negative results in applying 
judgments to projective material. Usually, 
overly complex units of projective material 
have been employed. 

3. In a few studies we have obtained posi- 
tive results by using samples of projective be- 
havior that were neither overly simple nor 
overly complex. 

4, The positive results obtained in two of 
these studies have represented encouraging de- 
grees of correlation. At the present stage, 
Cummings’ correlation of 50 with a crude 
criterion of adjustment, and Bialick’s correla- 
tion of .68 with Wechsler IQ may be consider- 
el respectable. 

5. Incidental comment has been made on 
other methodological considerations. All com- 
ments emphasize careful study of the clinician 
in setting the judgment task. 
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This paper reports an objective study indi- 
cating the correlation between judgments of 
intelligence based on Rorschach whole, or #7, 
responses and Wechsler-Bellevue IQ. How- 
ri a study was planned essentially to il- 
a = consider certain details of proce- 
jane the use of judgment scales with pro- 
raped material, In the section titled Details 
ia hod we will highlight and comment 

y on specific considerations. 


eo i tested in the study was: 

valid judg clinical psychologists an make 

eg of intelligence based on five 
V responses for each subject. 


Subjects and Judges 


has re of the study proper were 25 
giene Clinic on Pittsburgh VA Mental Hy- 
of World W ll were male, white veterans 
age was 28 year II. The mean chronological 
yeas, All ; a witha range from 20 to 39 
of neurosis Es a had a psychiatric diagnosis 
Se ot a wit no reason to suspect the pres- 
int schizophrenic reaction or of organic 
racranial involvement. The Rorschach and _ 
Wechsler were administered as part of the 
Toutine psychological evaluation. No subject 
a included who had not produced at least 
tive W responses on the Rorschach. The sub- 
Jects were further selected to provide a distri- 
bution of IQ’s exactly proportionate to Wechs- 
on a master’s thesis 


rtial fulfilment of 
University of 


mee article is based in part 
a mitted by Dr. Bialick in pa 

1e requirements for the M.S. degree, 
Pittsburgh, 1950. 


n *Published with the permissi 
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Veterans Administration, who assu 
bility for the opinions expressed or the 
drawn by the authors. 
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edicine and Surgery, 
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ler’s intelligence classification of the general 
population. No other basis of selection was 
used. 

In addition to these 25 subjects, 10 other 
subjects were used in the construction of a 
judgment scale by the method of paired com- 
parisons. Except in distribution of IQ, these 
10 subjects were comparable in all respects to 
the 25 subjects. In terms of 1Q, the 10 sub- 
jects were selected so that two subjects had 
Wechsler IQ’s within three points of each of 
the following IQ levels: 80, 100, 115; 125, 
and 135. fN 


The judges in the study were four VA sta 
psychologists, thoroughly trained and expe- 
rienced with both Rorschach and Wechsler. 
For purposes of incidental comparison, four 
less experienced VA psychologists in training 
were used as a second group of judges. None 
of the judges had any prior knowledge of the 
cases used in the study. 


The Judgment Scale 

In the construction of the judgment scale, 
10 subjects, 2 at each of five IQ levels, were 
used. From the Rorschach of each subject, five 
IV responses were selected according to an 
arbitrary system. These responses, including 
inquiry, were typed on 5 X 8 cards. The 10 
cards were then presented to four experienced 
judges in the 45 possible pairings. The pairs 
were presented in randomized order to two 
judges, and in reverse order to the other two 
judges. Each judge considered two cards at a 
time and decided which set of W responses 
had been given by the more intelligent sub- 
ject. 

‘From this paired-comparison method, the 
10 subjects were arranged in order of intelli- 
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gence according to each judge’s estimates. Rho 
correlations of validity and reliability, for 
these 10 subjects only, will be reported here 
rather than under Results. The rhos for indi- 
vidual judges against intelligence ranged from 
-71 to .87. The combined rankings of all four 
judges yielded a rho of -77, significant at the 
-01 level of confidence. The reliability rho for 
the ratings of two judges against two judges 
was .87, significant at the .01 level. These 
correlations were based on 10 cases, with two 
cases selected arbitrarily at each of five IQ 
levels. 

Only 5 of the 10 subjects were used in illus- 
trating the final judgment scale. At each of 
the five known IQ levels, that case was re- 
tained which had been judged correctly by the 
clinicians, and which best represented a dis- 
tinct step interval, The five cases retained 
were ordered by the judges in complete agree- 
ment with the criterion of Wechsler IQ. Fi- 
nally, a numerical scale value was calculated 
for each scale sample of five W responses [E 


P. 217], and the subject’s actual IQ was added 
a the scale card, 


Procedure 


Judgments base 
with Wechsler 


Results 
The four experie 
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made valid ju’gme: 
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five Rorschach W responses for each subject. 
The correlations of their judgments against 
Wechsler IQ were .61, .62, .69, and .73. TA 
mean correlation for any one judge, compute 
by Fisher’s method of weighted z’s La 
363], was .68, with a standard error of « z 
The reliability coefficient for two judg 
against two judges was .84. f 
The less AN judges also made valig 
judgments of intelligence. For these less * 
rienced judges, the four correlations were - ie 
-51, .54, and .59. It will be noted ae z 
highest correlation for a less experienced Ju E 
was not as high as the lowest correlation 5 
an experienced judge. However, the mean C0 
relation for the less experienced judges, + oF 
was not significantly lower than the mean f 
experienced judges, .68. The reliability Hie: 
relation for two less experienced judges again é 
the other two was .69. All correlations v 
significant at the .01 level of confidence, a 
the lowest for a less experienced judge whic 
Was significant at the .04 level. idity 
Because of the small N of 25, the vali t 
rho of .77 for 10 cases obtained in construt 
ing the judgment scale and reported in 
section on The Judgment Scale is of inter 
These 10 cases were additional cases not 7 
cluded in the 25 cases, and may be consider 
at least a suggestive replication. 


Details of Method dy 
The essential purpose of this small oe 
was to illustrate and consider certain details o 
procedure in applying judgment scales to, = is 
jective material. These details will be H e 
with brief comment, in this section under Ji 
terion, (c) material judged, (d) judges; ie 
the judgment task, and (f) generaliza 
from results. this 
Rationale. In general, studies such as the 
may be regarded as simplified checks on for 
projective approach and on specific claims es- 
the significance of unstructured hegre 
Eventuclly, a sufficient body of such stu ical 
should provide a sound basis for the ge 
use nf projective techniques. However, it S° ur- 
necessary to emphasize repeatedly that the r 4 
Pose is not to replace the whole projecte a 
proach with a set of scored scales which wie 
botched compromise, neither carefully tho 
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out in construction as traditional measuring 


scales, nor retaining the advantages of the pro- 
jective approach. 

A second consideration in terms of general 
Purpose relates to the question of validation. 
In this study, we report a correlation between 
judgments of unstructured behavior and scores 
on a highly structured test. The two samples 
of behavior represent approaches from two 
markedly different origins. However, we are 
not validating projective material in the sense 
of predicting future behavior in a real-life sit- 
eg A number of studies of projective ma- 

rial have reached for predictive goals that 
aah in advance of our present knowl- 
to ct an sh suggested a misleading answer 
techniane aan i question as: Will a projective 
Peaks oe ate as well with an intelligence 
i, other intelligence test will? Also, in 
ES ta = ti were chiefly interested in details 
eae ie ite process. Details of procedure 
pelea sidered best in a context where the 

R ation 1s at least a point or so above zero. 
this yer The outside criterion selected for 
ae re the Wechslex-Bellevue IQ. The 
S he study determined this selection, 

e significance of the variable as one of 


the most j 
important re . amie 
cedures, t reflected in projective pro 


We cho 
the field o 
ment. 


se an intelligence test because, in 
: f single artificial variable measure- 
new eee was the variable our judges 
the judges ed ge By training and experience, 
gence that ad developed a definition of intelli- 
actual ope was markedly influenced by the 
Every j Perations involved in the Wechsler. 

ty judge had used the Wechsler extensively 


wi 3 e a > 
with patients similar to the subjects of the» 


sady: They had had informal clinical expe- 
ience, with correction of errors, in estimating 
Wechsler IQ from Rorschach performance. 
When they made their judgments in the study, 
they knew that the outside criterion :was the 
Wechsler. The judges were as familiar with 
the judgment called for, and with the outside 
criterion, as they were with the projective ma- 
terial judged. Finally, the outside criterion 

ad an adequate degree of known reliadility 
and validity. 

Material judged. For each subject ‘in this 
study, the material judged consisted of five W 
responses given by the subject in a routine 


Rorschach. We wanted a sample of material 
supported by clinical experience as related to 
intelligence, and a sample retaining some de- 
gree of configurational complexity. However, 
we also wanted the sample to be small, repre- 
sentative for each subject, and comparable for 
each subject. 

Clinical experience over a period of time has 
tended to support X quality as related to intel- 
ligence. It is also probable that five W re- 
sponses will retain much of the configurational 
flavor of the total Rorschach. At the same 
time, the sample for each subject was brief 
and could be typed on a 5 X 8 card. The 
judges were never overwhelmed by a unit of 
material that was so complex as to be bewil- 
dering. The selection of W responses made 
possible the elimination of any subject who did 
not happen to give an adequate sample of be- 
havior pertinent to the judgment required. 
The material judged was also comparable for 
each subject. The problems that arise when, 
for example, the same judgment is made on a 
Rorschach with 100 responses and on a Ror- 
schach with 15 responses were avoided. i 

= 

Judges. In planning the present study, the 
specific training and experience of available 
judges were given careful consideration. These 
judges knew the projective technique, were 
thoroughly acquainted with the outside crite- 
rion in actual operation, and had worked with 
patients similar to those in the study. Their 
specific experience was both extensive and re- 
cent. This attention to specific and recent ex- 
perience may be more important than consid- 
erations of general academic background and 
clinical training. 


The judgment task. The present study was 
planned to make the judgment task as simple 
as possible, yet meaningful in terms of the 
judges’ clinical experience. This consideration 
accounts for the small number of cases, and 
for the small sample of responses per subject. 
The judges could work rapidly. They had no 
feeling that their judgment energy was ex- 
hausted after the first two cases. At the same 
time, the /7 responses seemed to be units that 


were sufficiently complex to retain an ade- 
quate degree of configurational meaning- The 
basis 


judges felt that they had at ‘east some 
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for estimating intelligence. 

The simple judgment scale was an aid rather 
than an encumbrance. Only five points were 
used on the scale. The five samples of behavior 
could be kept in mind. Each point was labeled 
with a known IQ as well as represented by a 
brief sample of W responses. Finally, mis- 
judged samples had been eliminated from the 
scale. Since each clinician may make judgments 
on a different basis, falsely judged scale sam- 
ples may be confusing. 

Generalization. A final comment should be 
made in regard to generalizing from the results 
of such a study as this, Disregarding the small 
N and the desirability of replication, let us 
suppose that a given degree of correlation can 
be established between these judgments and 
Wechsler IQ. 


that the Rorschach measures intelligence? or 


or such judgments to be valid. 
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Summary 


1. The study was planned with the specific 
purpose of illustrating and considering certain 
details of procedure in studies of judgment 
applied to unstructured material. Comment 
on some of these has been presented in the sec- 
tion Details of Procedure. The considerations 
discussed are related to the conditions neces- 
sary for valid judgments, and to the limita- 
tions indicated, 

2 In the study, experienced clinical psy- 
chologists made reliable and valid judgments 


yi 


of intelligence based on five Rorschach W f 


responses. The correlation 
Bellevue IQ 
tion, .84. 

3. Less experienced psychologists in training 
also made reliable and valid judgments of in- 
telligence on the same basis. Their judgments 
tended to be less reliable and valid, but not 
significantly so, 
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with Wechsler- 
was .68; the reliability correla- 
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The Clinician as Judge: Judgments of Adjustment 
from Rorschach Single-Card Performance’ 
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A review of the literature in clinical psy- 
chology in the past two decades reveals an in- 
creasing interest in the process and results of 
clinical judgment. Among others, Murray 
[10] and Hunt [8] have long urged a more 
intensive focus on clinical judgment and its in- 
gredients— Murray in calling attention to 

Psychology’s forgotten instrument,” the inter- 
Preter of test data, and Hunt in his consistent 
emphasis on the need to validate the clinician. 
R A strong impetus to investigation of clinical 
Judgment stems from the rapid expansion of 
the field of projective techsiques with their in- 
herent validation problems. The data yielded 

Y projective techniques, while for the most 
Part qualitatively wealthy and clinically useful, 
nave offered many vexing problems in categor- 
ization and quantification leading toward val- 
idation, Validation efforts based primarily on 
the use of isolated scoring abstractions, as for 
example the number cf human movement re- 
Sponses in a Rorschach, do not represent an 
adequate replication of the essential operations 
Involved in making inferences about personal- 
ity from such techniques, nor have the validat- 
ing efforts based on such abstractions been™ 
highly Productive of significant relationships 
with personality variables. On the other hand, 
research with projective technique data which 
more closely approximates the operations of the 
clinician-in-action, i.e., emphasizes the use of 

*Read at the meetings of the Eastern Psychologi- 
cal Association, Boston, April, 1953. Part.of a dis- 
sertation submitted to the University of Pittsburgh, 
1950. The author wishes to express his appreciation 
for the guidance received from his dissertationscom- 


mittee members, Drs. George W. Albee, Roy M. 
Hamlin, Gerald R. Pascal, and Carroll A. Whitmer. 
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clinical judgment, has often, although not uni- 
formly, yielded significant relationships with 
such variables [1, 2, 3, 4, 5, 11, 12, 13]. Such 
variables as the complexity of the judgment 
unit and the definability and stability of crite- 
ria will limit research in this area, as Hamlin 
[7] has emphasized in his review of variables 
in clinical judgment research. 

The experiment reported here evaluates the 
reliability and validity of judgments of adjust- 
ment inferred from single-card performance on 
the Rorschach test. It was designed to permit 
maximum use of clinical judgment in evaluat- 
ing the test data, while presenting judges witsì 
a circumscribed judgment task, the perfor- 
mance of a subject on a single Rorschach card. 


Method 


This research was conducted in two phases: 
a scale construction phase and a scale evalua- 
tion phase. In the scale construction phase a 
ten-point adjustment scale was constructed for 
each of the 10 Rorschach cards. In the scale 
evaluation phase, the ability of judges using 
these scales to discriminate between the Ror- 
schach single-card performances of subjects of 
varying adjustment status was evaluated. The 
reliability and validity figures reported here 
refer exclusively to the judgments of adjust- 
ment made in the scale evaluation phase. 

Scale construction phase. In the first phase, 
a ten-point Rorschach scale of adjustment was 
constructed for each Rorschach card, based on 
the pooled preferences of six judges who judged 
the single-card Rorschach performances of 
the 10 scale construction subjects in terms of 
adjustment. The scale construction subjects 
were white male veterans of World War II 
who showed limited variation in age aud ed- 
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ucational characteristics, but extensive varia- 
tion in adjustment status. In terms of nosology, 
the following gross categories were represented 
in the adjustment continuum: one normal (a 
nonvolunteer college undergraduate), five out- 
Patient neurotics, two outpatient schizophren- 
ics, and two hospitalized schizophrenics. The 
patients represented were chosen by the exper- 
imenter on the basis of case history informa- 
tion without reference to Rorschach data. 


The six scale construction judges judged the 
single-card Rorschach performances of the 10 
scale construction subjects using the method of 
paired comparisons. Typically, a judge was 
Presented with 45 folders containing the pair- 
ing of each subject with every other subject on 
a Rorschach card and asked to indicate for each 
pair, “Which Rorschach performance indicates 
the better adjusted individual?” Wherever 
“adjustment” required definition in this re- 
search, as in instructions to judges, the follow- 
ing combination of characteristics was referred 
to them as defining adjustment: “ability to get 
along with other people, psychosexual matur- 
“ity, freedom from anxiety and psychopatho- 
“ogy, and perception of reality in accord with 
prevailing cultural norms,” 

The quantitative 
ten points on each of t 
derived by the 


groups, representing di 
ment. ’ 
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A sample of 50 scale evaluation subjects 
was assembled with 10 members in each of thg 
five following groups: Group I, normals ; 
Group II, nonhospitalized neurotics; Group 
III, hospitalized neurotics; Group IV, ee 
hospitalized schizophrenics ; Group V, neice 
ized schizophrenics. The normals in the sample 
were a group of nonyolunteer college a 
dergraduates. The patients were panes 
from two outpatient clinics and two A 
by selecting consecutive cases that satisfied k e 
sample’s qualifying characteristics from 
current files of these services. The genera 


ifyi ae inclusion in this + 
qualifying characteristics for inclusion in t 


sample were as follows: male, white, 20-55 
age range, one-half year or more of collega 
training, no suspicion of having beige 
pathology. Additional qualifying criteria wer 
imposed for admission to subgroups, regarding 
length of hospitalization or nonhospitalization 
and manner in which diagnosis was reache 


[4]. 


Tt was recognized from the outset that def- 
inition of the independent variable, adjustment 
Status, in terms ot membership in these five 
diagnostic groups was a gross definition that 
would tend to attenuate the relationships eval- 
uated [9]. However, such a gross criterion 
definition is frequently used in prevailing prac 
tice, and it was our opinion that if results sug- 
gestive of significance were obtained with such 
a criterion, further refinement of the criterion 


s ees ance 
would lead to enhancegaent of the significanc 
of these relationships. 


The scale evaluation judgments of alee 
ment were completed by two judges, neither 0 


‘ whom had participated in the scale construction 


phase. These judges made their judgments of 
adjustment in the following fashion. The 10 
single-card performances representing an ad- 
justment scale for the Rorschach card in ques- 
tion wore ranked before the judge with the 
instruction that these performances represent- 
ed an adjustment continuum achieved by prior 
rating. He was then asked to familiarize him- 
self with the adjustment levels represented by 
the Scale members and, following this, to make 
his judgments of adjustment of the 50 scale 
evaluation subjects’ single-card performances 
by allocating each to the appropriate point on 
the scale, in terms of its being most closely com 
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parable with one of the scale members in ad- 

justment level, 
ae nks sop to the 50 scale evalua- 
ae en y these judges using the scales 
oe, ee into predetermined scale val- 
the utes ility coefficients were computed for 
ee ape of adjustment made on each 
ee or total series of judgments by prod- 
beeen i correlation of these scale values. 
sos n-Brown correction of these coeffici- 
$ produced measures of these judges’ joint 

reliability. 

oe of these judgments was eval- 
association “ai y by determining the degrees of 
ee eos Rorschach adjustment scale 
bership in re Dep group status, 1.€., mem- 
evaluating a the five diagnostic groups- In 
these variabl e degrees of association between 
epsilon eee, the unbiased correlation ratio, 
compiea ree! for broad categories, was 
sete ie o individual cards and for the total 
bined. ry e aperar score for all cards com- 
valuation urther refinement of the validity 
Syaluation Procene, which was made was 
total E tae significaace of differences 1n 
test. In all aR adjustment score, using the ¢ 
het e computations, the average of 
to: a ihrac Ron assigned by the two judges 
tuted his adj s Rorschach performance consu- 
seriés Bn sci score for that card. ‘Total 
ual subi adjustment score” either for indivi- 
jects or for adjustment groups is the 


avera 
SN ge of the scores achieved on all ten Ror- 
chach cards. 


Results and Discussion 


i 1 presents the reliability and validity 
the tot: i for each Rorschach card and for 
tion į al series achieved by the scale evalua- 

judges. á 
man cage . The judgments of adjustment 
high T the scale evaluation judges showed 
B TNA of reliability. Their reliability 
.89 cient for the total Rorschach series was 
Rea onnen significant at the 1 per cent 
ficients n individual cards their reliability coef- 
ard a from .90 on Card-III to .74 on 
of confid all significant at the 1 per cent level 
values "EA Despite the appreciable spread in 
statisti E the extremes of this series, 
terc T evaluation of the significance of in- 
ard differences in reliability suggests that 
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Table 1 
Reliability and Validity Indices of 
Scale Evaluation Judges’ Judgments of Adjustment 


Reliability Validity 
Card fè E E 
I 78 01 29 
Il 86 01 46 01 
Il 90 OL 50 O01 
IV 89 01 36 05 
v 74 01 44 01 
VI 86 01 AL 05 
VII -80 .01 61 01 
Vill 85 01 25 
Ix 82 01 40 05 
86 01 43 05 
Total series -89 01 50 01 


the judges showed little true differential reli- 
ability in making their judgments from card to 
card. Only comparison of the two highest coef- 
ficients on Cards III and IV with the lowest 
on Card V and Card III with the next lowest 
on Card I yielded ratios suggestive of signific- 
ance at the 5 per cent level. With reference to 
consistency of judgment then, these judges 
showed high degrees of reliability in making 
their judgments of adjustment. is 

Validity. The validity of these judgmensg, 
was first evaluated by correlating mean adjust 
ment score and adjustment group status. The 
epsilon value between mean adjustment score 
from the total series and adjustment group 
status was .90, significant at the 1 per cent 
level. The epsilon values on individual cards 
ranged from .61 on Card VII to .25 on Card 
VIII, as reference to Table 1 will illustrate. 
The four highest coefficients on individual 
cards are significant at the 1 per cent level, the 
next four at the 5 per cent level, and the low- 
per cent level. ‘Thus, 


tic status. 

_ Further evaluation of the ability of these 
judges to discriminate between the adjustment 
levels of these subjects was ‘made by compar- 
ing differences in mean adjustment score be- 
tween the five adjustment groups. Table 2 
summarizes the sample’s statistics for total ser- 
ies mean adjustment score. Inspection of these 
group means shows & consistent decline from 
Group I to Group V, albeit some of the dif- 
ferences in adjacent means ars small. Evalua- 
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Table 2 
Comparison of Adjustment Groups in 
Total Series Mean Adjustment Score 


Adjustment group 


Statistic 

bi II Ill IV y 
N 10 10 10 10 10 
Mean 1.33 1.30 1.13 1.05 81 
SD 10 15 -28 15 3 
SEn 03 05 09 05 14 


a possible 10 significant differences result. The 
normals (Group I) are significantly higher 
ps and the nonhos- 


Fisher £ Ratios on 


Adjustment Group Differences 
in Total Serie: 


s Mean Adjustment Score 


* Group 


u m IV V 
E a eer a 3.718 
IL LO 3.5788 gore 
mW ‘80 1.83 
Iv 1.60 
* Significant 
** Sipnitcant at $% lev of confidence. 


of confidence, 


In essence, then, the judges’ judgments of 
adjustment of these 50 subjects? single-card 


Admittedly, 
nd has little 


vagueness of the adj 
&rossness of the c 


S. Thomas Cummings 


case-worker ratings of adjustment based on sS 
terviews as a validating criterion. The on d 
used a seven-point adjustment scale deasa 
from the research reported here; ranked aa 
Rorschachs illustrated the points on the sca = 
the external criterion was psyohiettie ty a 
of case history information, which, piden 
ly, correlated highly (.79) with E 
Status, the criterion used in the research Pa 
ported here. Without evaluating other atten : 
ating factors, which these authors a eo 
prehensively, we would emphasize with F = 
Iin [7] that complexity of judgment pm oe 
total Rorschachs, Was a common factor in t He 
studies which probably tended to diminish t f 
obtained relationships. With 10 judgments d 
a less complex judgment unit, the single ee 
it would appear that a judge’s opportunities a 
intensive Coverage of his data are greatly 
hanced. Even though the factor of ene 
variability in performance is sacrificed aT a 
method, the greater familiarity with one’s air 
afforded by it through making 10 judgments 4 
coherent parts of a whole would seem to mor 
than compensate for this. -dinie 
A related methodological factor in clini 5 
judgment studies that has received little atte a 
tion but Probably also has an attenuating €t 
fect is similar to the factor of “esthetic gear 
Teported in esthetic judgment studies, ponk 
thing we could call “rater demoralization wt 
fatigue.” This appears to be primarily a tune 
tion of complexity of judgment unit and siza 
of total judgment task. Many judges who Pa- 
ticipate in clinical judgment studies report łe e 
ings of dissatisfaction and of being, ea 
whelmed by having to retain and manipu D 
xo many complex variables simultaneously a 2 
aving to continue to do so for what is pe 
ceived as a mountainous mass of protocols. 1 
such a factor exists, it is probable that it wou 


4 à + aships 
Nave a further depressing effect on relationship 
obtained, 


Finally, worthy 


ite its 
of restatement, despite 
obviousness, 


is the point that this and similar 
Studies have limited implications for the E 
of the Rorschach or any test as a clinical E 
Inferences gained from a test in clinical ae 
are typically evaluated within a context of ot È 
€r test and interview behavior data, frequen 
y including health and historical informatii 
ind interpretation of tests is a worth-whi 


e ioie 


ig 


7 


b JA 


D 
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training device, an interesting pastime, and a 
useful methodological feature of research on 
the bases and limits of clinical judgment. 
However, it provides crucial validation infor- 
mation chiefly in evaluating the assertions of 
ae partisans regarding the use of their 
k rite techniques in isolation, not in evaluat- 
g the validity of these techniques as they are 
characteristically used in clinical practice. 


Summary 


re = ten-point Rorschach scale of adjustment 
lir San neten for each Rorschach card. Six 
A s used the method of paired comparisons 
eee ot the single-card Rorschach perfor- 
ae 2 » subjects representing a broad 
a a ar aga The 10 ranked single- 
an Orschach performances plus the scale 
be es derived for them comprised a scale of 
Justment, 
diel: additional judges used these scales in 
EA the adjustment levels implicit in the 
ae n performances of 50 subjects of vary- 
Sees Justment status (five groups of 10 sub- 
ects each of normals, norhospitalized neuro- 


tics . . A > 

Bed e apitelined neurotics, nonhospital- 
chizophrenics itali izo- 

hrenics). , and hospitalized schizo 


ile heas anges made judgments of adjustment 
judgments ighly reliable. The validity of their 
ic status as related to the criterion, diagnos- 
order, not was for the most part of medium 
diagnostic Permitting accurate prediction of 
justment status from knowledge of mean ad- 
one, by Broke (average of judges’ ratings) a- 
‘© but indicating statistically significant re- 
unreliability in the criterion was 
obtained È robably attenuating the relationships 
ere, c 
Sten factors in clinical judgment research, 
as complexity of judgment unit and “rater 
o 


atio; i g 3 
nships between these variables. The inde- 
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demoralization and fatigue,” are briefly dis- 
cussed. 
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The Clinician as Judge: Total Rorschachs 
and Clinical Case Material * 


Richard L. Newton 


University of Pittsburgh 


This research is an investigation of the value 
of a clinical technique (the Rorschach test) 
and the validity of clinical judgment as re- 
flected in interpretations of total Rorschachs 
and clinical case material. 

The study had three objectives. The first 
and primary objective was to ascertain to what 
degree psychologists’ judgments of adjust- 
ment from Rorschach protocols agree with 
psychiatrists’ judgments of adjustment from 
clinical material on the same subjects, 

The second objective was to discover to 


what extent Rorschach judgments agree with 
psychologists’ judgm 


Psy ents of clinical case ma- 
terial. The third objective was to determine to 
what degree psychiatrists and psychologists 


agree in making judgments of clinical case ma- 
terial. 


Method 

Adjustment Scales 
As a preliminary step, 
scales of adjustment 
mings [2] derived 


two quantitative 
were constructed. Cum- 


split-judging 


group technique, the 


1D which yielded 
significant product- 


moment corre], 


In the present study, Cummings’ scale was re- 
duced to seven points to eliminate tied Tan 
and to produce more discrete spacing of a 
scale values. The elimination of three scale 
values did not narrow the range of adjustment 
represented. In the remaining seven subjects 
there were one socially adequate subject, three 
neurotics, one nonhospitalized schizophrenic, 
and two hospitalized schizophrenics. All wer 
white male veterans of World War II. ‘esd 
A Rorschach adjustment scale was enh 
by having each of six qualified Roreha ® 
workers rank the complete Rorschach eel 
of these seven subjects in order of over-all a à 
justment. Normalized scale values were co 
puted from mean ranks, producing a et 
point Rorschach adjustment scale. The re A 
ability of the Rorschach rankings for the sev 
subjects was estimated bya split-judging group 
technique, which yielded the highly significan 
product-moment correlation of .94. 


The Use of the Adjustment Scales 1 
The scales: for clinical histories and ie = 
Rorschachs were employed in obtaining judg 
ments of the over-all adjustment of each of $ 
experimental subjects made up of five eou 
of 10 subjects each. The five groups vi 
socially adequate subjects, nonhospitalize 
neurotics, nonhospitalized schizophrenics, ^ oP 
Pitalized neurotics, and hospitalized schiz! 4 
phrenics. The sample of 50 subjects was “se 
parable in age, education, sex, color, and age 
ment range to the seven subjects employed ! 
constructing the adjustment scales. 0 
Psychiatric adjustment scale. Each of ve 
qualified psychiatrists was asked to judge 4 
Stracts of clinical material (basic data sheets 
of 15 of the experimental subjects in terms ° 
adjustment as represented by the range ae eae 
y the seven scale subjects. Each judge W 
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SS 


Total Rorschachs and Clinical Case Material 


Presented with the basic data sheets of the 
a hao subjects and used the relative 
< placements of these subjects as a guide in 
ee each of the 15 experimental subjects 

‘a on the seven-point adjustment scale. 
aa a independent judgments of adjust- 
et = obtained for each experimental 
OF in i mock pe possible the computation 
ento of the reliability of psychiatric 
ei ced of 10 clinical psychologists also 
dite Li er of adjustment from the basic 
actly the Š of the experimental subjects in ex- 
10 psychi ame manner as that employed by the 

latrists. 

ewe adjustment scale. The same 10 
at pane ot all skilled in the Rorschach, made 
subjects hs adjustment for the experimental 
schach fale global Rorschachs. Each Ror- 
schachs of T was presented with the Ror- 
relative s 3 e seven scale subjects and used the 
as a oie 3 placements of these Rorschachs 
Pétimental = Placing each of 15 of the ex- 
Point Rors a ge at a point on the seven- 

Stacha ach adjustmeat scale. None of the 
was E a by any Rorschach expert 
sheets he had trom subjects whose basic data 
possibilit judged. Therefore, there was no 
; sibility of a psychologist associating a sub- 


Ject’s basi £ 
schach, sic data sheet with that subject’s Ror- 


Results 


Th , te 
P following results were obtained: 
sheets Sychiatrists’ judgments of basic data 
i aea a very high degree of reliability 


reveal hologists judgments of Rorschachs 

ed a high degree of reliability (.73)- 

Sheet: sychologists’ judgnients of basic data 
04 ) revealed a very high degree of reliability 


a Psychologists judgments of Rorschachs 
o E ie with psychiatrists’ judgments 
relations| ata sheets to determine the degree of 
Ments np or agreement between the judg- 
fae he the two disciplines when each discip- 
e a different instrument of evaluation. 
Wasi resulting correlation coefficient (.09) 
ot significantly different from zero. 
Were Psychologists’ judgments of Rorschachs 
compared with psychologists’ judgments 
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of basic data sheets to determine the degree of 
relationship between the two sets of judgments 
made by the same discipline with two different 
instruments of evaluation. The resulting cor- 
relation coefficient (.20) was not significant- 
ly different from zero. 

6. Psychologists’ judgments of basic data 
sheets were compared with psychiatrists’ judg- 
ments of basic data sheets to determine the 
degree of relationship between the judgments 
of disciplines when both disciplines were using 
the same instrument of evaluation. The result- 
ing correlation coefficient (.86) is significant. 

7, Finally, psychologists’ judgments of Ror- 
schachs were compared with placement in the 
five nosological groups to determine to what 
degree the Rorschach judgments were associ- 
ated with diagnostic categories. The resulting 
eta (.23) was not significantly different from 
zero. 

Discussion 

The question arises as to whether or not the 
criterion was a good one. The following 
evidence suggests that the criterion was good. 
Very high reliability resulted from the jud 
ments of the criterion material by judges 
both disciplines, thus showing agreement with- 
in each of the disciplines. The correlation 
(.86) between disciplines in judging the cri- 
terion material was very high also, showing 
general agreement among the “experts.” 

Newton and Goodman [4] compared the 
psychiatrists’ judgments of the basic data sheets 
with placement in five diagnostic categories 
and obtained an eta of .79, significant at 
the 1 per cent level. These findings suggest 
that the criterion of psychiatric judgment is 
positively correlated with diagnostic classifi- 
cation. However, in the same study, Newton 
and Goodman found that psychiatrists’ judg- 
ments of basic data sheets did not correlate 
significantly with Buhler Basic Rorschach 
Scores [1] of the 50 Rorschachs. Although 
their study constituted a different approach to 
Rorschach evaluation, the findings were con- 
sistent with those of the present study. The 
findings of Hamlin and Newton [3] suggest 
that concentrated study of limited data will 
produce positive results. 


Summary à 
This research investigated’ the validity of 
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clinical judgments of adjustment based on glo- 
bal interpretations of Rorschachs and on clini- 
cal case material. The method employed incor- 
porated an adaptation of psychophysical scaling 
techniques wherein a Rorschach scale of ad- 
justment was derived from psychologists’ 
judgments of adjustment of Rorschach proto- 
cols and a psychiatric adjustment scale was de- 
rived from psychiatrists’ judgments of adjust- 
ment based on clinical case material. 

The use of these scales by psychologists and 
psychiatrists in judging the adjustment of 50 
experimental subjects resulted in four basic 
findings: 

1. High reliability was obtained in each of 
the three judging tasks: clinical case material 
by psychologists, by psychiatrists; Rorschachs 
by psychologists. 

2. A significant relations 
between Psychologists’ an 
ments of case material. 


j 3. Rorschach judgments did not correlate 
significantly with psychologists’ judgments of 


hip was obtained 
d psychiatrists’ judg- 


Richard L. Newton 


case material or with psychiatrists’ judgments 
of case material. 

4. Rorschach judgments did not correlate 
significantly with placements in five diagnostic 
categories. 


Received November 18, 1953. 
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Intra-Individual Consistency in Response 
to Tests of Varying Degrees of Ambiguity’ 


Arthur C. Carr 


Creedmoor State Hospital and Adelphi College 


Pose he ee implicit in all testing proce- 
S repeats nat the behavior elicited in the test is 
icteric oF sample of the behavior char- 
as well [29] he individual in other situations 
ticular Je = 1. Projective techniques in par- 
all beha an heavily upon the assumption that 
persela manifestations, the seemingly su- 
of the ; AS well as the obvious, are expressive 
i € individual’s personality [1, 17, 24]. 
ia research, however, would seem to 
tive hy i caution of Bellak that “the projec- 
siderable hesis .. . has to ke handled with con- 
plete wah T [, p.5]. The literature is re- 
avioral indings which suggest that be- 
niques. measures based on projective tech- 
[3, 5. wae be inconsistent and unpredictable 
3, /, tL, 16, 22, 25, 26, 27]. 
ess a nical practice an assumption neverthe- 
dividual that apparently unrelated intra-in- 
tical, į responses may be motivationally iden- 
structure 1 may stem from the same causal 
to reme p n light of this assumption, it 1s well 
whil mber that tests merely record behavior, 
a e clinical insights are arrived at through 
minie in the Veterans Administration and 
irector, me the approval of the Chief Medien 
Y the author Matements and conclusions pu ne 
are a result of his own study an 


Not , d 
kes any reflect the opinion or policy of the 
ans Administration. 


fuli aaPted from a dissertation submitted în partial 
Bree, Unie of the requirements for the Ph. D. de- 
ike io ey of Chicago, 1952. The author would 
Sistance ank Dr. Donald W. Fiske for his kind as- 
Phases and understanding guidance throughout all 
as well the research on which this article is based, 
other coms Drs. Hedda Bolgar and Julius Sc:man, 
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inference [17]. It follows that consistency or 
orderliness in personality must be found in 
what is inferred to lie behind the responses of 
the individual rather than in the varied overt 
aspects of his behavior. 

The purpose of the present study was to in- 
vestigate an aspect of the projective hypothesis 
dealing with the consistency of an individual’s 
responses to projective tests that vary as to de- 
gree of ambiguity or structuredness. It 
seemed obvious from previous considerations 
that any meaningful consistency in behavioral 
expression must be found in what is “behind 
or in what motivates, a given response rather 
than in some gross or surface feature of the re- 
sponse. Therefore, the diverse test responses 
were organized in terms of what could be in- 
ferred to be their underlying feeling tone, 
emotion, attitude, or motivating force. ‘This 
quality was called the “inferred affect” of a re- 
sponse. In terms of relevance for personality 
dynamics, a classification of four fundamental 
qualities evolved: hostility, positive feelings, 
anxiety, and dependency. 

The investigation studied the intra-individ- 
ual consistency of responses elicited by the 
Sentence Completion Test (SCT), the The- 
matic Apperception Test (TAT), and the 
Rorschach test. The Forer [12] version of the 
BCT was chosen because of its systematic 
coverage of interpersonal relationships. 

As is apparent in Table 1, each of the chosen 
tests contains stimuli that are assumed to 
elicit responses from which can be inferred the 
subject’s attitude or feeling tone with respect 
to important human figures—mother, father, 
females, males, people, and persons in author- 
ity. These stimuli vary in embiguity—from 
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Table 1 


Test Stimuli Pertaining to Various Interpersonal Figures 


Figure Forer SCT 


TAT Rorschach 


Mother His earliest memory of his 


mother was 
+ Most mothers 
. My mother 


he felt 
. Mothers 
Father 9. His father always 
Most fathers 


. My earliest memory of my 
father 


. Whenever he was with his 
father, he felt 

. Fathers 

Females . When I meet a woman, I 

Sisters 

- Most women 

- My first reaction to her was 

- As she spoke to him, he 
Most women act as though 


. Men 


« My first reaction to him was 
Most men 
. Brothers 


a Males 


+ Most men act as though 
People - His new neighbors wi 
- I feel that people 
. A lot of people 
hen I meet people I gen- 
erally feel 
~ Most people are 
henever he is 
people, he 


ere 


Authority + When he met his boss he 
Taking orders 

People in authority are 

+ When they told hi 


m what to 
do, he 


DA 9 


- When my mother came home, I 
When he was with his mother, 


When my father came home, 1 


- While he was speaking to me, I 


introduced to 


Picture 6 BM 
(Elderly woman 
and young man) 


Card VII 
“Mother” card 


Picture 7 BM 
(Elderly man 
and younger man) 


Card IV 
“Father” card 


Picture 4 
(Woman clutching 
man's shoulders) 


Female percepts 
seen 


(Cards I-X) 


Picture 9 BM 
(Men lying on 
grass) 


Male percepts 
seen 


(Cards I-X) 


Picture 2 


Human percepts 
(Farm scene) 


Animal percepts 
(Cards I-X) 


Picture 1 


Card IV 
(Boy and violin) 


1. Sometimes 1 feel that my boss 


Statements on the SCT direct] 


such people as « y referring to 


mother figure [21, 23]. On 
TAT pi 
woman and the young 


card) would lie between the extremes. oe 
variations in stimuli are also present for ot ee 
important figures. For example, the SCT res 
cludes items referring directly to such figu i 
as mother, father, females, males, people, T 
authority figures, while the Rorschach 4 1e 
Provide means for assaying the same ae 
lationships through stimuli whose represen 


rh 


Consistency in Tests of Varying Degrees of Ambiguity 


tional values are less immediately apparent. 


r The study was concerned primarily with the 
intra-individual consistency of responses elicit- 
ed by varying stimulus representation of each 
Interpersonal figure. It is to be stressed that 
these responses were classified in terms of their 
inferred affect, i.e., hostility, positive feelings, 
anxiety, and dependency. 
_ A frequent assumption in clinical practice 
Is that stimuli more similar to the object being 
considered will elicit tendencies closer to a- 
PE than will stimuli that are less like the 
A a Te is assumed that affect and impulses 
os esin toward the real object, or 
elicited z oo of it, are nevertheless 
Gans A ess ‘threatening stimuli which, by 
eect certain qualities, still represent or 
[18] h or” that object. Although Lazarus 
ae nie! ged suggested the desirability of 
eta: en her extension of the ambiguity con- 
a: Ta that represented in the usual bat- 
study re lagnostic tests, the tests used in this 
Continu En a wide range on such a distance 
resultin m. herefore, it was believed that the 
erty pals would provide a comparison 
el sean t i covert and the more overt aspects 
parit onality functioning and reveal any dis- 
y In such levels of function. 


Method 


an oe tests were administered to 
clinic i e patients in a mental | hygiene 
doubted ormal diagfiostic classifications un- 
mild n y would have revealed a range from 
h A pare to that of borderline psychosis. 
fiers i of the differences in levels of adjust- 
with owever, all subjects were functioning 
co ie degree of success in everyday inter- 
o i relationships. No attempt was made 
es isl the group for intellectual level, age, 
thes Geh classification. It was believed that 
3 z Tas within any one individual would 
n ae ly rather than differentially operative 
tests. The subjects ranged in age from 
te es to 41 years, with a mean of 32. In- 
a i ent (W-B) ranged from 84 
T » with a mean of 141. 
whee oS were administered in the normal 
itive ig gatine psychological testing. The 
oad items of the SCT were administered 
ach subject, The pertinent items were later 
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abstracted for purposes of this research. The 
Rorchach test was administered according to 
the methods suggested by Beck [2]. Seven 
cards were chosen from the TAT on the 
basis of the applicability of each card to assay 
the interpersonal relationship under considera- 
tion (Table 1). Three qualified psychologists 
chose these cards as most appropriate for elicit- 
ing affect toward each specified figure. Ad- 
ministration followed standard TAT proce- 
dure. 

The inferred affect of all pertinent responses 
was independently scored by two qualified 
clinicians. Each test was independently scored, 
neither judge being aware of which response 
belonged to any subject. 

It became obvious that the original intention 
of maintaining similar categories of inferred 
affect within and between tests could not be 
sustained, because all stimuli did not evoke 
productions whose qualities were characteris- 
tic of every anticipated category. Thus, while 
the SCT evoked a large proportion of pos- 
itively toned responses, the only qualities in- 
ferred from Rorschach responses proved $ 
be those of hostility, anxiety, and dependency, 
with a category of neutral or unclear respon- 
ses. Similarly, the categories within a given 
test were not applicable to all the various fig- 
ures. For example, no dependency category was 
inferred from TAT themes pertaining to fe- 
males, males, people, or authority figures. The 
categories of inferred affect, therefore, were 
ultimately established in terms of the particu- 
lar set of responses evoked from the particular 
group of subjects. 

Rorschach scoring. After the Rorschach tests 
had been scored according to standard pro- 
cedures established by Beck [2], every human 
and animal percept (H, Hd, A, and 4d), along 
with its accompanying inquiry, was extracted 
from the total record and entered on coded 
cards, The first responses to Cards IV (father 
card) and VII (mother card) were also en- 
tered on separate cards. This procedure was 
used, rather than attempting to arrive at scores 
based on over-all reaction to the card, as re- 
search had suggested the reliability of this 
method [4]. Judges rated each extracted re- 
sponse for inferred affect in terms of on® of the 
following qualities: hostility, positive feelings, 
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dependency, anxiety, and “other” (neutral or 
unclear). Through joint discussion of the cri- 
teria established by DeVos [9] and Elizur 
[10], they were acquainted with the general 
method for scoring. Although the numerous 
subcategories established by DeVos were not 
utilized, his quantitative approach to the scor- 
ing of Rorschach responses in terms of what 
he calls “affective symbolism” greatly facilitat- 
ed the ordering of the data. 


Of 662 responses so classified, judges agreed 
on 617, a Percentage of agreement of 93.2, Per- 
centage of agreement between j 
pared with that which would 
tained on a chance basis, Critical 
on Rorschach scoring, 
indicated that on all 
ment obtained was sign 

ifferences in scoring 
discussion between th 
varying interpretation: 
Proximately 2 per cen: 
responses were necessa: 
category. 


udges was com- 
have been ob- 
ratios obtained 
as well as on other tests, 
comparisons the agree- 
ificant at the .001 level. 
were later resolved by 
e two judges. Where 
S were not resolyed (ap- 
t of the total number), 
rily placed in the “other” 


D TAT Scoring. Prior ti 
tach story was extracte 


Overtly attributed characteristics (TAT- 
overt) were classified į 


itive feeling and hostil. 
was applicable to all 
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Hostility ee 
1. Pressure from partner or peer — prohi iii 
compelling, punishing, quarreling, nierien 
2. Physical harm inflicted by peer or pa H 
3. Physical harm inflicted to peer or partner. 
4. Death or illness of peer or partner. 
5. Disappointment in peer or partner. 
6. Bad news to peer or partner. E 
7. Degradation or depreciation of peer or ee 
8. Departure — when they suggest co 
goals, desire of hero to get away. 


Dependency . a ie 

1. Succor from peer or partner —secking o 
ceiving aid, advice, consolation, etc. 

2. Nurture — bestowing aid, support, care. adency 

3. Filial obligation — when duty and depe lat 
predominate, If obligation implies hostility, 
ter quality may predominate. : hero 

Pe ome departure is seen by ! 
as necessary to “becoming a man,” etc. aa Ae 

5. Rebellion against authority, domina! ie 
pendency — when strivings for independenc 
greater than hostile elements. 


Anxiety s situation 
A sit 
1. Concern over the future, outcome of 


; the un- 
» Fear of what will happen, fear of 
known, 


ae 4 sse ig posed. 
3. Decision — where a difficult choice is P' 

4. Occupational concern. 

5. Curiosity, 


6. Moral struggle, illicit sex, guilt. of anx- 
7 Departure — when departure is source 
iety and grief to the hero. 


8. Confession, admission of guilt. 


t 
In a total of 300 stories so'rated, aprem 
between judges was 91 per cent on rating on 
ferred effect of themes, and 94 per es re 
overtly attributed characteristics of the figu 
being assayed. 


S 
SCT scoring. The original four categori 
of inferred affect were maintained in de 
scoring results—positive feelings, hostit: vee 
pendency, and anxiety. Neutral or unclea an 
Sponses were categorized as “other.” In & d 
eral, scoring was done in terms of the tak- 
vious m.aning of the completions, aie ed 
ing completions at their “face value. ive 
“Most mothers are good” was scored post ot 
feelings without questioning whether or p 
the real meaning was that “most mothers 4 
good but mine is not,” etc. 


The categor 
completions in 
toward the fig 
security. 


I 
re 5 i pa 

y positive feelings pertained r 

which the primary attitude y or 
ure was that of acceptance, lov 
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ae category dependency included those attitudes 

y ich were primarily ones of dependency or im- 

ed compliance. Childishly toned responses, of- 

= Pertaining to eating or being fed, or the expres- 
n of child-like feelings were classified in this 

category, 

oat category of anxiety was applied to all com- 

a ons in which the primary attitude was that of 
mee anxiety, or insecurity. 

ae, Category of hostility contained all those com- 

ae | in which the primary attitude expressed 

foe d _the figure was that of avoidance, deroga- 
pie eal or pure hostility. 

fel ad remaining responses which could not be 

aie ato the above categories were classed as 

on a statements generally fell into this 
At i 

ea pa of 35 sentence completions were 

does or each subject. Agreement between 

S was 1,594 out of 1,750 responses, or 


+l pe : i í 
Hei i r cent. Differences in scoring were re- 
ed in discussion. 


Statistical Treatment of Data 
Ratin 


wack gs for each figure being assayed in 


ta ee now available for every subject. 
Tatings mest on of opportunities for such 
male, hu ied (as with the number of female, 
orschach st; and animal responses evoked by 
changin T, responses were equated by 
Sponses ts] em into ‘percentage of total re- 
for all subj Where the number was constant 
each te (as with the completions for 
given affect fo the SCT), occurrences of a 
taled, Ratin, for each, figure were simply to- 
were dich ngs for the total group of subjects 
Point for otomized in terms of the median 
and 4 number of occurrences (or presence 

E sence) of each affect category. 
hia subject was now scored in terms or 
and “low” placement in each affect 
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category for each interpersonal figure. The tab- 
ulation compared “high” and “low” groups 
on each variable with the “high” and “low” 
group of every other variable. 

Chi-square tests of independence were used 
to test the relationships between these vari- 
ables [19]. Yates’s correction for continuity 
was applied in all instances. One-tailed tests 
of significance were applied to all predicted re- 
lationships, i.e., the tabled probabilities for the 
chi-square distribution were halved because 
only positive relationships were to be consid- 
ered as significant [15]. 

In the results presented, only these predict- 
ed relationships are dealt with. Ancillary find- 
ings are to form the basis of a separate report. 
The number of relationships predicted includes 
only those in which similar affect categories 
were maintained. Lack of a dependency cate- 
gory on certain figures assayed in the TAT, 
for example, eliminated the possibility of a con- 
sistency between it and dependency as elicited 
by the other tests’ representations of the same 
figure. Since no similar category was present 
on which to have made a prediction of cons 
sistency, none was made. One could argi 
however, that if real consistency prevailed, af- 
fect categories would necessarily have to be 
similar between all tests. Any dissimilarity be- 
tween such categories should then be considered 
an exception to any basic consistency in person- 
ality expression. On the other hand, if a par- 
ticular stimulus fails completely to elicit a cer- 
tain affect category from a wide range of sub- 
jects, the evidence hardly should be interpreted 
as showing a lack of consistency within the 
subjects. It seems better to assume that the 
stimulus was structured in such a way (in 
spite of its relative unstructuredness) that cues 


Table 2 


Consistency of Inferred Affect for Predicted 
Relationships between Tests 


Total number of relationships, 


Tests compared Significant Significant 
Rona Predicted at 5% level at 10% level 
C] 

Rea and total TAT 22 6 ($ <.001) 12 (p < .001) 
orschach and TAT-theme” + 5 (p < .001) 9 (p < .001) 
Rorschach ra ae 8 1 (nonsig.) 3 (p<.05) 
Tot n 22 1 (nonsig.) 5 (p<.05) 
yee and SCT 27 9 ($ < .001) 12 (p < .001) 
TAT ee 13 3 (p<.05) 4 (p <.03) 
vert and SCT 14 6 (p< 001) 8 (p < -001) 
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for “appropriate” behavior were so obvious as 
to limit the nature of the responses. 


Results 


Of 22 predicted relationships between the 
Rorschach test and the TAT (Table 2), six 
were significant at the 5 cent level of confi- 
dence and twelve at the 10 per cent level. 
Marked contrast occurred, however, when af- 
fect variables based on the TAT themes were 
isolated, as five were significant at the 5 per 
cent level and nine were Significant at the 10 
per cent level. Comparison of Rorschach and 
TAT-overt variables reveals that of eight pre- 
dicted relationships, only one was significant 
at the 5 per cent level of confidence and three 
at the 10 per cent level, The greater part of the 
consistency between the Rorschach test and the 


TAT appears to reside in Rorschach and TAT 
-theme inferences. 


Of 27 Predicted re] 


4 predicted rel ti i 
SCT and TAT: relationships between 


C -overt variables, six were sig- 
nificant at the 5 per cent level and eight at the 
0 per cent level. The greater part of the con- 


veen and the TAT ap- 
pears to rezide in SCT and TAT-overt in- 


r , the number of si; 
ships was tested’ by the b 
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Discussion 


The extent of the relationships generall y 
supports the conclusion that there is cne 
tency in an individual’s responses to tests a 
varying degrees of ambiguity.’ That this a 
sistency is found not in the overt manifesta 
tions of behavioral responses, but rather in an 
inferred explanatory construct related to ae 
tivational aspects of behavior, would seem a 
sistent with the classic study by Frenkel- 
Brunswik [13]. 


It is obvious that the demonstrated sages 
tency is far from perfect. To what degree t 
is dependent upon the somewhat arbitrary =a 
egorizing of test stimuli (particularly in a 
gard to the TAT), on the inadequacy of pa 
Scoring system, or on factors more directly T! 
lated to the subjects is not known. 


The individuals chosen for this study com 
prised outpatients at a mental hygiene wy 
It seems likely that, as recently suggested ot 
Hanfmann and Getzels [14], the degree = 
consistency between expressions elicited fro š 
different levels may, be a function of pere 
ality integration. Greater consistency roy h 
then have been expected with a group of “no 
mal” subjects, and less consistency in a an 
of frank psychotics. Only further resear 
could verify this assumption, however. , 

In spite of the lack of perfect consistency» 
one point seems unequivocal: There is no that 
Port for the suggestion sometimes made t ill 
the opposite, or converse, of a given affect Ta 
appear at more overt levels as contrasted T 
that which exists at a deeper level. The a 
is definitely in the direction of consistency ily 
vher than that of antithetical or dinette 
opposed relationships, i. e., reaction formatio! 


“x POART * on- 

2An analysis involving the intra-individual Cn 
sistency within tests as reflected by the gene cople, 
tion of a given affect from mother to females, ee to 
and authprity figures, as well as from fat cale 
males, people, and authority figures, had rev was 
that the generalization within the various Ca si 
only slightly above that expected on a chanti Me- 
This finding would appear consistent wit lize 
Clelland’s statement that “while a set of general ab 
expectations about fathers and mothers or Dae le 
child relationships probably do develop... they jon 
Most certainly do not derive in any simple fas y é 
from the actual characteristics of the parents oF e 
child’s relationships to the parents . . . . There Ei 
many influences which enter into the formulation~ 
such generalized conceptions” [20, p. 308]. 
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foris generalization, however, would hold only 
ae ee levels of functioning are repre- 
=e the chosen tests. This is an important 
onstrated as preliminary research had dem- 
inferred ng significant agreement between 
from a to mother and father taken 
either pare ata and feelings expressed toward 
ently dis has a rating scale. While appar- 
on ifying SCT data as necessarily re- 
sari “We of overt manifestations, in the 
for outw: ae inwardly accessible and chosen 
X e yar tape the finding would not 
that the SCT e with the clinical impression 
Teal sense is a projective technique in the 
3 of the word. 
oo tps: to note that least consis- 
the SCT revealed between the Rorschach and 
Hae ae tests representing the extremes in 
Consistenc stimulus ambiguity, while greatest 
tests andl he as found between each of these 
could aes TAT. The findings perhaps 
Ceptual the een predicted on the basis of per- 
erally Ssh Bruner has written: “Gen- 
Univocality ee the less the structuredness or 
striking Pe “saa stimulus input, the more 
tors will be role of directive nonsensory fac- 
Pantzahatt ro determining the perceptual or- 
dae [6, p. 161]. 
strated Arae to the nature of the demon- 
of inference ionships is the fact that the levels 
Personality Pee: ved, as well as the levels of 
the tests, a unction assumed to be tapped by 
that these...” roughly equivalent, suggesting 
h ese results are not fortuitous. 
Wild geen spite of research evidence which 
consistent gest that behavioral measures are in- 
that ENS unpredictable, it would appear 
avioral r relationships can be found in be- 
ally dissi onses and that responses superfici- 
consistency ar may nevertheless reflect a basic 
Peson and orderliness in perception and 
the eat That this can be demonstrated in 
ase of quantifiable variables which have 
Meaning in t eS 4 j 
Sonality t} SUIS of both projective and per 
mulation of is evidence that a dyr.amic for- 
Possibilit ot personality does not preclude the 
of qr tY Of meaningful. quantitative analyses 
clinical data, 
Summary 


The i a i 
n intra-individual consistency of the in- 
affect of responses to projective tests of 
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varying degrees of ambiguity was studied. 
Variables were established in terms of given af- 
fect categories related to specified interpersonal 
figures. These categories were dichotomized 
about a median, and the statistical method used 
to determine the relationships between them 
was chi square. 

Analysis of data demonstrated greatest con- 
sistency between the Rorschach test and the 
TAT, and between the TAT and the SCT. 
Least relative consistency was present between 
the Rorschach and SCT. The greater part of 
the consistency of the TAT with the Rorschach 
test lay in ratings based on TAT themes, 
while the greater part of the TAT’s consis- 
tency with the SCT resided in ratings based 
on the overtly attributed characteristics of the 
varying interpersonal figures. The greatest 
consistency appeared among variables based on 
levels of inference as well as on those 
levels of personality functioning which approx- 
imate each other. While the obtained relation- 
ships showed far from perfect consistency, the 
extent of the demonstrated relationships justi- 
fied the conclusion that there is a basic con; 
sistency and orderliness in perception and pd 
sonality which may underlie the variability in 
behavioral responses. 
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Rorschach Concepts of Normality’ 


Ann Lawler Brockway, Goldine C. Gleser, and George A. Ulett 
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St. Louis, Missouri 


D Ta T past decade the Rorschach test 
aa Pe a fre- 
itary perso normal” individuals, either as mil- 
Ples in ex nnel or as members of control sam- 
the ie rimental research, As a result of 
Subjects aie accumulation of data on such 
regarding R of the widely held concepts 
schach pi T constitutes a “normal” Ror- 
apers by T have failed to be substantiated. 
and Wisthae pow Brussel and Hitch [3], 
Presented su r, Rotter, and Gillman [12] have 
among mili mmaries of Rorschach findings 
[1] and ath personnel, while Beck eż al. 
lished pS and McReynolds [4] have pub- 
Varied occu on samples of normal adults from 
should a Contributions such as these 
Clinicians oe to some degree have caused, 
certain Rors h more cautious in interpreting 
Pathology Š an characteristics as signs of 
vise many F have made it necessary to Te- 
constitutes of the widely held tenets of what 
more eviin normal protocol. It is becoming 
affected by f that the perception of inkblots is 
igence KA actors such as sex, race, age, intel- 
irom ace and set and that individual 
of person Wee be interpreted on the basis 
essary ae ity variables alone. It appears nec- 
9 eat a that a careful accumulation 
the total ac data on representative samples of 
these he anes stratified with regard to 
tions of = be obtained, so that interpreta- 
°pproprises ology may be made on the basis of 
ie te norms for each individuat. j 

zii point has been raised, however, particu- 
tract Tae was completed under Air Force Con- 
er 33(038)-13884. It is one of a series 


Under 
R and D Project 21-37-002, Division of Psy- 


chiatri d 
of i eenig of Flying Personnel, Department 
cal Psychology, United States Air Force 


Choo Bind 
l of Aviation Medicine. 
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larly by Klopfer [8] and more recently by 
Beck eż al. [1] that normality when regarded 
as a statistical average may differ widely from 
a qualitative definition of normality as mean- 
ing well balanced. This is admittedly true, but 
it does not mean that we can make interpreta- 
tions which are not confirmed by the empiri- 
cal data. A possible solution to this dilemma is 
to base norms on individuals who are not only 
engaged in everyday activities implying ade- 
quate adjustment but who have also been in- 
terviewed by a psychiatrist and considered to 
be relatively free from neurotic symptoms. S fi 
a criterion, while far from perfect, would te 
to yield a more homogeneous sample with re- 
gard to personality adjustment. The purpose of 
this paper is to make a beginning in this direc- 
tion by summarizing Rorschach scores of a 
group of white subjects homogeneous with re- 
gard to sex, age, education, and set, and psy- 
chiatrically screened on the basis of personality 
adjustment. The scores for the well-adjusted 
members of this group are compared with 
those of the maladjusted, and also with scores 
obtained on a group of psychiatric patients, in 
order to examine the influence of personality 
adjustment on Rorschach percepts. Our results 
add further evidence that many of the rule-of- 
thumb “signs of normality” used by inter- 
preters of the Rorschach are inadequate. 
Procedure, 


€ 

A group of 151 men without history of psy- 
chiatric disease, and 40 male patients with a 
variety of psychiatric disorders in which mani- 
fest anxiety was considered the predominant 
symptom, were administered the Rorschach 
test by one female examiner and screened as to 
psychological adjustment by one male psychi- 
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Table 1 


Statistics on Age and Completed Education for 151 Normal Subjects 
and 40 Patients 


Education completed (grade) 


Group No. of Age (years) : Distribution 
cases Median Range Median [7 12 13-15 16 and over 
Adjusted 126 22 17-36 14 6 31 38 51 
Maladjusted 25 22 18-33 15 0 7 6 12: 
Total normals 151 22 17-36 14 6 38 44 bs 
Patients 40 29 18-36 12 9 11 9 t 
atrist. The Rorschach was administered second Results 
in a battery of 


psychological tests. The de- 


tailed procedure has been reported elsewhere 


[11]. All of the 
unteers, oriented 
administ 
of a pr 
Air Fo 
that the set toward th 


Table 2 presents the 50th percentile scores 
in the major Rorschach scoring areas for oe 
total normal group and the 50th percentile 
ranks found by Cass and McReynolds [4] on 
a group of 104 “normals” (median age, 9%; 
median grades completed, 12). Their figures 
are shown only for those categories for whic 
the scoring methods were the same. In com- 
paring these values it should be noted that the 
statistics used by Cass and McReynolds are 
not quite identical with the exact median point 
used in this study. Even so, their findings are 

“cable 2 f 

Median Scores for Various Rorschach Scoring 

Categories in a Normal Sample of Young Ma ma 

Compared to 50th Percentile Ranks Obtaine 

by Cass and McReynolds on Comparable 
Scoring Categories 


> ass and 
Rorschach o M olii 
category N= 151 N= 104 

R 969 * 22.5 
M 2.0 2.0 
FM 3.7 3.5 
m (m, mF, Fm) 1.2 -5 

© PR 0.2 0.0 
K (K, KF) 0.1 0.0 
k (k, kF) 0.2 0.0 
F 11.1 7.5 
Fe 1.4 2.0 
c (c, cF) 0.7 0.0 
C (ct, CYR, FC’) 0.9 1.0 
FC 0.9 1.5 
CF 24 2.0 
C (C, Cn, C sym.)0.0 0.0 
IC 2.8 3.0 
Content 
H 2.4 2.5 
Hd 1.0 0.5 
A 9.1 9.0 
Ad 14 1.0 


P 5.6 5.5 
a E E N a 


e 
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J 


A to those presented here, which is 
in eid ee" remarkable since their sample 
Be oi females and a somewhat wider 
fon ihe a range than did the sample 
Weise a y- i he major difference appears to 
PE enn yo tained a smaller median number 
fs ae ma an equivalent reduction in 
EE response. They also obtained 
Be ewer responses determined by ¢ and 
terat ore categorized FC. It would be in- 

ing to determine whether these differ- 
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ences could have been due to the inclusion of 
females in Cass’s study. In both Cass’s data 
and ours it may be noted that FM is greater 
than M and CF is greater than FC, although 
the reverse inequalities have usually been ac- 
cepted as indicative of good normal adjust- 
ment. - 
Beck’s results are not directly comparable to 
ours because of differences in scoring catego- 
ries. Also, he presents his results in terms of 
means and standard deviations, despite the ex- 


Table 3 


Medians, 20th, and 80th Percentile Points on Various Rorschach Scoring Categories 
for a Normal Sample Classified as to Personality Adjustment and for a Sample 
of Psychiatric Patients 


as 
Rorschach Adjusted normals Maladjusted normals Psychiatric patients 
Categor (N = 126) (N =25) (N=4) 
y Percentile scores Percentile scores Percentile scores 
R 20th 50th 80th 20th 50th 80th 20th 50th 80th 
Lees: 15.9 26.6 39.9 14.7 249 30.5 iss, 224 esas 
w ation 
p Y W Dw) 47 84 136 62 93 135 sa 8.0 13.8 
dr 5.8 121 22.3 Ws ano 18:5 4:5 10.5, 219.5, 
S 8 2.9 7.5 J 1.9 4.5 0 1.8 Ta 
W% z9 2.9 5.9 5 2.4 4.2 14 2.9 58 a 
D% 16.7 33.2 58.7 21.8 4.8 70.5 164 "30.5 “65s 
dr% 27.1 48.4 62.2 20.5 46.0 61.8 20.5 45.5 64.50 
S% 3.6 121 227 3.7 $8 9 14.5 0 8.2 28.0 
Determin z 3.6 10.1 18.8 2 9.5 14.5 6:3 11:8) ES 
M ants 
ru 9 2.0 3.4 2 1.2 2.8 2 11 3.1 
m (in 1.3 3.9 6.9 1.8 2.8 5.8 1.2 3.2 4.8 
» mF, Fm) 4 1.0 2.7 A 2.0 3.2 0 -9 1.8 
k F 1.2 0 2 1.2 0 a 1.0 
ae KP) o i3 a o a m 0 í 9 
> kF) 0 2 12 0 a a2 0 igi” Vette 
Fe 61 11.5 20.7 4.4 9.6 16.8 6.2 105 17.3 
Ta 2 14 3.1 2 1.2 3.0 a 1.0 2.8 
a ae ) AA G 1.9 0 1.0 3.8 0 .2 1.6 
ro’ CF: FC’) 0 8 2.26 2 1.2 2.2 a 9 21 
CF Pi 1.0 2.2 0 -7 2.2 0 8 1.8 
C (e 4 2.2 4.2 1.9 3.2 5.2 6 1.6 34 
Sar Ca, Csym.) 7 i 0 2 0 a 2 0 ak 25 
a 9 2.6 4.6 1.8 3.9 5.8 a 1.9 4.4 
poe 
Ha 9 2.60 45 9 1.9 4.0 6 1.5 3.1 
A 0 1.1 3.6 0 6 2.5 0 16 . 4.0 
Ad 5.4 94 13.5 5.0 8.0 11.0 3.0 6.7 9.8 e 
At 2 1.9 2.0 0 Pi 3.5 0 3 3.5 
Sex 6 2.3 4.5 1.2 2.2 3.9 A 24 5.8 
le] 0 0 3 0 0 3 0 a 4 
a so A ae ó al i o Ja 
Ob., Art 0 0 4 0 2 a 0 a A 
PA es ‘| OR SF so wie g T 28 a% 
E eN s 33 6 t2 a4 RS 7 aoa 
(0 4.1 5.7 8.2 3.3 5.1 7.0 34 5.5 7.2 
1.6 5.0 11.0 3.5 5.0 95 a 18 3.8 9 


ie ei 


treme skewness of distribution of the scores in 
Most categories. However, we might note that 
he also found mean CF greater than mean FC 
for his sample, 

Table 3 presents the 20th, 50th, and 80th 
percentile scores in the major Rorschach scor- 
ing areas for the screened normals, the mal- 
adjusted normals, and the patients. It is be- 
lieved that the “adjusted” group is a fairly 
Tepresentative sample of young adult white 
` males of higher than average educational level 

and relatively good personality adjustment. 

herefore, the middle 60% range of scores 
should approximate that which may be con- 
sidered usual or typical for such a group. 

From Table 3 it can be noted that the ad- 
justed normals are slightly 
responses than either 
or the patients. Some 
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nevertheless some trends are apparent. It ap- 
pears that as degree of maladjustraent pat: 
there is a diminution in productivity and a ‘4 
in the use of M as a determinant and H an 
A as content. On the other hand, there 15 an 
increase in the use of # and pure C as poe 
minants. Unpublished research done at the i 
oratory has demonstrated that when FC x 
omitted from the C’ category and otto 
points are established with respect to num J 
of R, the incidence of this determinant (C i 
C’F) in protocols can be used to canoe 
adjusted from the maladjusted subjects and A 
patients (C’ + C’F less for adjusted a 

One of the most important facts to be 0 : 
tained from Table 3 is that the range of Ke 
for the middle 60% of the adjusted eer 
is often greater than is generally consider Ba 
optimal by Rorschach workers (Klopfer, Bru 
sel, and Hitch). This is particularly uas ) 
Coe asl B= 59%), dry (49-23%) 
(4% - 19%), FM (13 - 6.9), and te 
(0.4—4.2). For other categories the mi hér 
range is shifted somewhat lower or hig : 
than is postulated. It is suggested that ae 
norms for Rorschach categories might be 
be developed by obtaining data on. samp t 
such as the present, in which psychiatric E 
ings are utilized to screen out the oylan 
maladjusted and then the middle 60% used t 
define the expected or optimal range. 


Figure 1 presents the psychogram ri 
median scores) of the psychiatrically ore 
normals studied in this investigation alone 
with a textbook illustration of the yee 
Rorschach Psychogram [2, p. 128]. A ahe 
Farison of these Psychograms reveals rhan c 
screened “normals” used F , FM, m, k, the 
and C’ to a relatively greater extent than nd 
hypothetical normal, with M, FK, Fc, FG, re 
CF being used to a lesser degree. It will a 
be observed that the ratios of M to FM ao 
FC to CF differ in direction in the two PSY 
chograms, with FM and CF exceeding M an 
FC respectively in the screened normal group» 


' 

: s 

Table 4 shows the incidence of oe ame 2 

[5] Rorschach signs of adjustment in the oe 
chiatrically classified subgroups. Using C° 

ed 

Use of FC’ as a determinant was demonstrat 


to be a sign of good adjustment. 


HYPOTHETICAL NORMAL PSYCHOGRAM 


FM 
fe m K FK coc C FC CF 
JUSTED NORMAL SAMPLE N=126 
Hig. 4 ; > 
Payohogram a son of the hypothetical normal 
Us at obtai res a 
| justed normal saisie obtained on the present ad 
monly $ 
Y accepted Rorschach signs of adjustment 


t a 
he ne, criterion, Davidson reported 
absence rp gion between the presence 
of each sign and the total number 
ag relyingeon internal consistency as 
validity. By comparing the percent- 


or 


is of Signs, th 
me the test of 


`o age 
N tp eh group showing a sign, it may be 
| in the dire number of the signs discriminate 
avidson de opposite to that predicted by 

+ Thus a larger percentage of the 


| id 


l 


n 
| P the case of Sum C> (Fe+e+C’); F% 
1% ob $50; %R VII-X240 añd <60; 
Al di and refusals, in that the percentage 
adjusted normals, and in some cases of 
of the S owing the signs was greater than 
Justed. The signs that held up, though 
Fa to a statistically significant degree 
er a one-tailed hypothesis, were M2 


of m 
Patients, 


not alwa 
even un 


eT 
the 5 2 
ymbul < means less than or equal. 
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Patie 

: feria M > FM and Dr+8<10% than 
re er group within the normal sample.* 
S was also a reversal in expected direction 


he s 
‘ymbol > means greater than or equal, and 


3; P24 but < .30 R; R>20; FC22; no pure 
G; FK + Fc22; and FC=CF. For the latter 
sign it should be noted that it is necessary to 
exclude cases for which /C=CF=0 in order 

to obtain the discrimination. Davidson did not 

specify this exception. Also for the P scores it 

was necessary to alter the criterion where R 

was less than or equal to 13. For these cases 

4 P’s were considered a sign of good adjust- 

ment. 

Special note should be made of the incidence 
of shading and color shock in the three psy- 
chiatrically classified groups. Using the cri- 
teria proposed by Munroe [10], we found 
that only three of the subjects in the total 
normal group were without evidence of color 
shock (1.6% of the adjusted normals and 4% 
of the maladjusted normals) and 14 were 
without evidence of shading shock (7.9 and 
16%). Though 100% of the patients showed 
some evidence of color shock, 10% of this 
group were without evidence of shading shock 
as compared to 7.99% of the adjusted normals. 
These findings are remarkable not so much as 
indicating a reversal in expected trend but as 
pointing out that what has been te 
“shock” actually occurs to some extent in al- 
most all Rorschach protocols. Thus these 
signs, at least when defined according to 
Munroe’s criteria, cannot be used in detect- 
ing maladjustment. This criticism has also been 
posed in an article by Keehn [7], who makes 
a review of the literature with reference to 
color shock and concludes that the sign is of 
questionable value in the diagnosis of neurot- 
icism. 

‘That as great a proportion of the adjusted 
normals refused one or more cards as did the 
maladjusted is rather surprising, since card re- 
fusal has been accepted by most clinicians as 
pathological. The highest incidence of card re- 
jection in our normal sample occurred in a 
group of 15 career military men, 13 of whom 
were sergeants and 2 commissioned officers. This: 
subgroup had 5 members (33 1/3%) who 
rejected one or more cards. This finding is 
in agreement with the report of Linn [9] 
that “wwell-adjusted” military personnel fre- 
quently reject Rorschach cards. In our sample 
it was noted in particular that Cards V and/or 
VI were rejected more frequeatly by the “ad- 
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Table 4 sissies 
Application of Dayidson’s Signs of Adjustment on Rorschach to Present pl 
Classified According to Psychiatric Criterion 


Probability of no cm 
(One-tailed hypothesis 


: \djusted 
Percentage of group in which ren = 
Rorschach sign sign was present poe versus 
penent Adjusted Maladjusted maladjusted patemi 
normals normals Patients normals unai 
16.0 30.0 ` m 
oa 40.5 20.0 22.5 .03° 
2C > Fe +e 52.4 64.0 45.0 Bred ae 
20 < F% < 50 59.5 a pa we Reversed 
Dr + S$ < 10% 37.3 48. 5. s 
P >4< 300R N P 09 
(igen vin R< 13,P=4) 69.0 60.0 57.5 19 S 
R> 20 68.3 64.0 55.0 — 22 
FC > CF #0 36.5 20.0 30.0 -06 ‘9 
FC > 2. 31.0 24.0 20.0 24 ee 
No pure C 86.5 76.0 80.0 .09 
a 
k 2 = 60 34.1 36.0 20.0 Reversed > 
FK 4+ FC 22 62.7 60.0 47.5 — Pos 
W:M > 1:1 and < 3:1 21.4 12.0 20.0 15 Reversed 
A% < 50% 67.5 80.0 72.5 Reversed ee 
No color shock} 1.6 4.0 0 Reverse Reversed 
No shading shock} 7.9 16.0 10.0 Revers o7 
Ho refusals 87.3 88.0 77.5 Reversed = 
A Statistically significant, 


y reversed is meant that 


the adjusted ni ls hi q 
+ As defined by Munroe [10]. dusted normals have the lower percentage. 


Justed normals” 


: than by maladjusted normals 
or patients, 


scored by o 
was done u 
set. 


and the testing 
t conditions and 


normal” 
th percen- 
McReynolds 


group were compared with the 50 
tile ranks obtained by Cass and 


ber of responses, which 
mainly in the F 


their finding 
n M and CF 


The 
greater than FG in the normal protocol. Te 
latter inequality is also confirmed by 
data. , 

Since most Rorschach interpretations E 
based on the concept of normal in the senini d 
well adjusted, rather than average, it was oi 
that the most meaningful norms to bee 
tained from the present sample would be t had 
based on screened normals, All subjects 
veen interviewed by a psychiatrist and ae 
as to over-all adjustment. The — J 
rating was used to vlivide the sample me 
justed and maladjusted normals, and the Ate 
50th, and 80th percentile scores were prese. a 
ed for these subgroups. In addition, the scora 
of 40 patients with symptoms of manifest ile 
iety were presented for comparison. wa a 
Some commonly accepted signs tended to dif oa 
entiate the :naladjusted and/or the patie 
front the screened normals, many others 
not hold for this sample. In particular, the a 
justed group used K and m to as great an T 
tent as did the anxious patients. The midd 
60% of the group showed a wider range © 


| 
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Wh, dr%, 8%, and FM than is usually con- 

sidered optimal. 

mir shock and shading shock as defined by 
unroe were found to some extent in all but 

a very few protocols and thus, as presently de- 


fi À 3 A 
ned, are of no value in detecting maladjust- 
ment, 


lead a great deal more empirical 
Dotor E si to determine meaningful 
ata orschach. In particular, the in- 
Lak such factors aS Sex, race, age, educa- 
esc i TES background must be 
necessary 3 and separate norms obtained when 
accouiit Al order to take these factors into 
in ete vig Rorschach interpretation 
Umat or = ee on the concept of the op- 
appears es oe Rorschach protocol, it 
normal aa e to obtain norms for screened 
Satribut Ups. The present paper makes a 
the faethe in this direction by indicating 
a groin Een score and middle 60% range for 
mal, whit : omg, psychiatrically screened, nor- 
ucation. It io es of more than average ed- 
a aika 4 oped that comparable data will 
groups. Such or other relatively homogeneous 
Pe < norms would greatly increase the 


ficie a t a 
tion, ney and validity of clinical interpreta- 


Rose 
ecetved November 20, 1953. 
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Attempts at Psychometric isolation of pa- 
tients with the dia 


le, neuropsychiatric patients, 
etween experimentals and con- 


> Completed fewer 
and does not con- 


S correlation 
nt ratings of total 


difference 


experimenta] and control 


pci a Siae tin E 
3 nA 
hi icati tye checks 
Congtess D otoduplication Service, 1; 
2 Fron: t Ve 


he eterang i i 
Chillicothe, Ohio, «a Administration 


ive were 
a lesser degree. Similarly aan present 
various correlations duplicate between visu 
investigators. The Pearson aS and yocabu: 
motor score and age, pe and —3!+ 
y, respectively, were . ay a + score 
T iultiple r between ee as heryer 
age, vocabulary, and grade k vocabulary T 
visual-motor score and age and is reported a 
42. The corresponding enelanien arably , Jo a 
Graham and Kendall were A D relation d 
Less supportive results occurre scores. 10 " 
the distribution of bine oe scores, a 
spect to both raw and oo contro ee 
much larger percentage of i scor dan a 
subjects fell above the critica eF Galt 
brain damage. Whereas only Its” had di 
and Kendall’s “normative ae prain" 
ence scores assigning them to i ure was an 
category, our corresponding E d by mee 
similar low percentages were n a ee 
other control groups when aol v 
used, whereas 28% of on ae group 7 more 
ed by this method, Experiment: thods are 
y both raw and difference 29 and 43% 
nearly alike, our respective 3 sal 50%: ~ 
Proximating their 45%, 50% { increased, dual 
results thus suggest the use o e to ind! ener 
tion in attributing brain aah high by € 
neuropsychiatric patiénts ol 
the raw or difference method. 
Brief Re ort 
ah 23, 1954. 
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Determinant Shift of 
Psychotic 


Robert G. Gibby and 
VA Regional Office, 


RE de paper [2], three areas of the 
aad Hade o the Rorschach free association 
(a) ‘digi bs investigated. These were: 
fect of the imılarity; (4) the comparative ef- 
eah ani ry pong value of the examiner on 
ality char c) the relationship of the person- 
fron ioe acteristics of the subject to changes 

Bri € association to inquiry. 

riefly summarized the findings were: 

he free association record differs sig- 

antly from that of the inquiry. 


Nific 


2T he free association is less susceptible 
miner influence than the inquiry. 
y Te pp characteristics, as measured 
those indi i of the Rorschach, of 
signifi viduals changing the most differ 
Th cantly from those changing the least. 
imene ings suggested that there were 
gation oth 2 the Rorschach worthy of investi- 
the traditi cr Phat „those presently tapped by 
orschach de Scoririg method. The changes in 
to inquir ae from free association 
hife” * which we shall call “Determinant 
changes ake oe offered promise. ‘These 
acity of a a very well be related to the cap- 
to nierien] Ject to respond to new stimuli and 
ationshi T, a structured interpersonal re- 
of determi or instance, the degree of shift 
Predict Neon s has been used successfully to 
ing thera ability of a subject to form a last- 
The peutic relationship [3]. 
Score A pe iar of the Determinant Shift 
free ete atively simple matter. First, the 
dently of t ion responses are scored indepen- 
Text, the he material elicited on the inquiry. 
quiry respo combined free association and in- 
nses are scored. These scorings pro- 


to 


Fr 2 
om the VA Regional Office, Detroit, Michigan. 
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Psychoneurotic and 
Patients ` 


Bernard A. Stotsky 


Detroit, Michigan 


duce two psychograms, one for free association 
and one for the inquiry. The score for each 
determinant on the free association is then sub- 
tracted from the score following inquiry. This 
results in a shift score for each determinant. 
The Determinant Shift score for all determi- 
nants except F will usually be either zero or 
positive, whereas for F the score will almost 
always be zero or negative since the shift is 
most often from F to some other determinant. 
Consequently, the' shift in F may usually be 
regarded as reflecting the total amount of 
shift. o 
The administration of the Rorschach Vis 
made up of two interdependent, yet quite dif- 
ferent, procedures. The first, the free associa- 
tion, is relatively unstructured. The subject is 
simply requested to free associate to the Ror- 
schach cards as they are presented to him. 
The second, the inquiry, is more highly struc- 
tured. Here the subject is asked to explain and 
to clarify the previously given associations, to 
delineate the area of the blot utilized and to 
describe what characteristics of the blot sug- 
gested the response. The inquiry itself requires 
greater attention to, and much more direct in- 
teraction with, the examiner. It may be hy- 
pothesized that the more sensitive the indivi- 
dual, the more responsive he will be to the ex- 
aminer. We would then expect greater shift 
žo be shown on determinants from free associa- 
tion to inquiry by more sens‘tive and mure re- 
active subjects. 

To test this hypothesis, a group of 40 psy- 
choneurotic outpatients at a Veterans Ad- 
ministration clinic was compared with a group 
of 40 psychotic inpatients at a Veterans Ad- 
ministration general, medical, and surgica 
hospital. The specific prediction was that the 
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Psychoneurotics would show greater shift on 
Rorschach determinants from free association 
to inquiry than would the psychotics. It was 
also predicted that they would show greater 
shift on variables supposedly more indicative 
of anxiety (FY, Total Y) than on those pre- 
sumably related to the more stable aspects of 
the personality, such as color and movement. 

The Rorschach determinants investigated 
were F, M, FC, CF, G, FY, YF, Y, F, Total 
Y, and Total C. Only those determinants 
were studied which yielded large enough fre- 
quencies to warrant analysis. 
techniques were employed for scoring these de- 
terminants. Indices of determinant shift were 
then calculated for each record Ci. Reliability 
of the scoring was determined 
Pose, 10 records Previously 
the authors were randomly 
entire sample and then resci 
person who had been traine 
Scoring techniques used in the study. Pearson 
product-moment correlations between the two 
Scores were computed for each determinant, 
Porh for the free association by itself and for 
tse total response. For free association the 
mean reliability was -90; for total response the 
mean reliability was -94, 


n order to co 


Beck’s scoring 


. For this pur- 
scored by one of 
selected from the 
ored by a second 
d previously in the 


total number of 
ailable Psychoneurot- 


a 
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shift from free association to inquiry might he 
a function of existing differences on free i 
sociation, the two groups were compared on ss 
determinants in the free association. he 
nificant differences were found for any of t 
determinants. 


Results 


A previous study [2] demonstrated that = 
determinant shift for F may serve as a E 
dicator of the shift in all determinants r 5 
free association to inquiry. This index Bii 
used in the present study to compare ee the 
shift of the psychoneurotic with that o se 
psychotic group. The psychoneurotic aoe 
showed, using the sign test,? more cha a 
with the difference in the index of mg 
nant shift for F being significant at the ao 
level. The prediction that the ee 
group would change more from free ass 
tion to inquiry was thus upheld. de 

The indices of determinant shift for ah 
shading variables (FY and Total Y) in T 
group were also compared by the sign test., at 
differences between the groups were eee 
for both variables, For FY, the difference T 
significant at the .01 level; for Total Y, at 
-001 level. 


i indi f de- 

The differences between the indices mak 

terminant shift for the color and mwen y 
variables were not found to be statis 


s of 
2The first test of the hypothesis was by en of 
the sign test. A problem pre ented itself in f shift 
what to do with cases where the amount 0 ` for 
from free association to inquiry was the EE 
both groups. The following procedure was ae 
adopted: The results of the sign test were P ight 
on a normal curve; first, going from left to renter 
the proportion of cases where the shift was E por” 
for psychotics; then the ties; and finally ene neu? 
tion of cases where the shift was greater ies for 
Totics. Next, the distarice between the z oe sees 
the ties was found. Then, with the mean set a ae 
half of the distribution of ties was plotted eee 
side and half on the other side of the mean. ae 
that point,’determining the theoretical Hequiegs table 
the ties was simply a matter of consulting the from 
of normal curye functions and adding the area A 
m to g on both sides of the mean. The LT a for 
the curve thus obtained was multiplied by 40 ing 
tke theoretical" frequency of ties. The remain 40 
area dn each side of the curve was multiplied Py ae 
to give th: theoretical frequency for the cases v for 
Psychotics showed more shift than neurotics an ák 
cases where neurotics showed more shift than py 
chotics, The chi-square values (two degrees of fre s 
dom) betwecn obtained and theoretical frequencié 
were then computed for the three signs, 


í 
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Determinant Shift of Psychoneurotics and Psychotics 


a The index of shift for color tended 

E e igl i and that for movement lower, 

ihe a ee oneurotic group. The results of 

N gopa of the groups by determinants 
marized in Table 1. 


Table 1 


C . z 
omparison of Neurotics and Psychotics 


on “Determinant Shift” by the “Sign” Test 
„Determinant P> N° PN" N>Pt > 
= ao 
M 8 5 27 .001 
FY 12 21 7 46 
YF 7 s 25 .01 
7 3 31 6 64 
A = 39 1 = 
3 31 6 64 
"ate 5 9 26 001 
CF í 16 17 12 
a r a 12 46 
Total C 9 u 20 aw 


* Insta: 
nees i f 
neurotics fron in which psychotics shifted more than 
be Instances i free association to inquiry. 
Toties in which the amount of shift for neu- 


S3 and i 
nquiry, psychotics was equal from free association to 


t Insta: i z 
chotics aces in which neuroties shifted more than PSY- 
ree association to inquiry. 


e F aean differences in determinant shift 

compared h otal Y, and Total C were then 

Was not y means of the ¢ test. The t test 

asmuch used for the other determinants in- 

skewed be oe distributions were markedly 

results “al the presence of many 0 scores. These 
are summarized in Table 2. 


c e Table 2 
omparison of Neurotics and Psychotics 
on “Determinant Shift” by the ¢ Test 


Means 
hh Psy- Neu- 
nant chotics rotics Diff. n $ 
a sis u 200 2B 
Total Y 1.23 2.38. 115 3.19 01 
Total 142 983 asl 397 i 
g 1.38 1.85 47 ijs 2 


hae findings for t agree very closely with 
Nifican ip the “sign” test. Neurotics show sig- 
ey T greater shift for F, FY, and Total Y. 
ables o show more shift for the color vari- 
signifi ut again, as for the sign test, not 
F ; icantly. z 
t E mee findings it can readily be seen 
and Toz mina Shift scores for F, FY, 
of confi al Y differentiate at a significant level 
idence between neurotics and psychotics 
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in the predicted direction. Fifty-six out of 80, 
70 per cent of the patients, are correctly iden- 
tified when the median for the shift in Total Y 
for both groups is used as a point of division, 
with scores above the median classified as neu- 
rotics and scores below the median as psychot- 
ics. The number of cases correctly classified 
is significantly better than chance. Their 
greater ability to shift suggests that psychoneu- 
rotics show more sensitivity to the testing situa- 
tion and respond to the additional stimuli of 
the inquiry more actively than do psychotics. 
The greater increase in shading from free as- 
sociation to inquiry among psychoneurotics 
may be indicative of the presence of more anx- 
iety in their reactions than in those of the psy- 
chotics. 

Among the determinants of the Rorschach, 
the amount of shift may well be the important 
variable differentiating psychotic and psycho- 
neurotic patients. The present-day method of 
scoring the total response, including both free 
association and inquiry, tends to obscure such 
shifts. Examination of our data demonstrates 
the point clearly. Comparison of the w 
groups by the traditional method of scoring Ñe- 
terminants shows significant differences only 
on the shading variables FY and Total Y. On 
the other variables the shift from free associa- 
tion to inquiry leads to a convergence of the 
groups. For example, neurotics show more F on 
free association than psychotics. As a result of 
the shift from free association to inquiry, psy- 
chotics end up with more F. Similarly, psy- 
chotics show slightly more FGAGE,G; V5 VE, 
Y, and M on the free association; as a result 
of the shift, psychoneurotics end up with 
slightly higher scores for these variables. The 
differences which exist between the two groups 
in the amount of shift, howeve:, tend to be 
concealed; in the case of F, a very significant 
difference. 

Comparison of psychotics with most and 
least shift. In the previous study, in comparing 
the 40 psychoneurotics who shifted most with 
the 40 who shifted least, significant differences 
were found for F, M, and FC on free associa- 
tion. The tentative conclusion drawn from the 
data was that the group shifting least was 
more comfortable in the interpersonel situa- 
tion and less ready to interpret the situation as 
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one of threat. The question arose as to wheth- 
er the same held true for psychotics. Would 
a group of psychotics who shifted little com- 
pared with a group who shifted considerably 
show the same differences on M, F, and FC? 

To test this hypothesis, 16 psychotics giving 
shift scores of 0 and 1 were compared with 15 
giving shift scores of 5, 6, and 7. Since there 
was a significant difference for R between the 
two groups, the arc-sine transformation was 
used to control for R. F: isher’s exact test was 
then applied to the data, the fourfold categor- 
ization being in terms of presence or absence of 
the determinant on free association. Significant 
differences at the five per cent level of confi- 
dence were found only for M, CF, and C, 
with the group that showed the most shift giv- 
ing more M and CF Tesponses, and the group 


that showed the least shift giving more pure 
C responses. 


» any conclusions 
reached here must be tentative, Work is in 
Progress to validate the findings of the present 
up of psychotics selected 


Robert G. Gibby and Bernard A. Stotsky 


Summary 

In this study a new dimension of the her 
schach, the determinant shift from free assoc 
tion to inquiry, was applied to a group of psy 
chotics and psychoneurotics. 

he specific predictions were: . 

i inc wd show greater shift from 
free association to inquiry than psychotics. 

2. Neurotics would show greater ewig 
variables presumably indicative of anxiety, a 
and Total Y. Using both the ¢ test api 
sign test, both predictions were confirmed 4 
very significant levels of confidence. De 

It was further demonstrated that the : 
terminant Shift score emphasized ae 
between the two groups that the classical mee 
od of scoring the determinants tended to 0 
scure. 

Sixteen psychotic patients who shifted i 
were compared on the free association pi 
with 15 psychotic patients who shifted me 

he group which showed most shift gave sig 
nificantly more M and CF, while are 
which showed least shift gave significantly 
more pure C, The firldings for psychotics were 
compared with those for psychoneurotics, wa 
the implications of these findings were a aa 

In view of the significant findings of eo 
and other studies, the Determinant Shift scor! 
appears to be suitable for further experimen- 
tal investigation and validation. 
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Rorschach Card Rejection in Psychodiagnosis 


Ivan N. Mensh and Joseph D. Matarazzo 


Washington University School of Medicine 


PI sk ar as of rejection of the stimu- 
served S of the Rorschach test has been ob- 
na Rorschach’s early work with this 
tin P method. He noted the differential 
Fo ance of card rejection by normal, neu- 

C feebleminded hysterical,” and schizo- 
phrenic subjects: i 


PE ae answer. Normal subjects almost never 
Hioni a response for the several plates. Oc- 
caŭsed ne neurotic subjects fail to answer; this is 
minded inhibitions due to complexes. Feeble- 
peie SRCA] subjects often reject the figures 
swers: wet ae afraid they will give stupid an- 
‘ire PE N with an ‘intelligence complex.” Fail- 
Phrenics, e = occurs in a typical manner in schizo- 
Cases: an ee in latent or practically recovered 
they ioe denly refuse to answer, even though 
along. ‘The m giving many and good responses all 
dinarily co — may come with figures not or- 
Gsunnourken? ered difficult. The blocking may be 
an answer able although in all other kinds of cases 

may be obtained on coaxing [8, p. 22]- 


oe i his early monograph [1], also sum- 
Jections a p sychological meaning of card re- 
Totic pads the schizophrenic, depressed, neu- 
to “block; ceblemirtled, relating the behavior 
tion” jp rh negativism, or stuporous condi- 
ition and € first group; to “generalized inhi- 
“se f-diste self-depreciation” in the second ; to 
TOtics : wei and lack of confidence” in neu 
Klopfer to “criticism” in the feebleminded. 
and Rie Kelley [6] present greater detail 
e E of card rejection; 
ections s amines the “main indications of re- 
9], Zubi, the various plates” ; Yacorzynski 
among ab [10], and Zubin and Young [11], 
Z others, make passing reference to the 


Phenom, 
~ omenon of on = 
Subjects, Rorschach card rejection by 


j 


bs of these reference texts ii the 
ever, any method does not indicate, how- 
nificance ie oes basis for differential sig- 
Nostic on card rejection by the various diag- 
ups seen in clinical practice. Further, 


a study of the indexes of Psychological Ab- 
stracts since 1946 and of the Rorschach Re- 
search Exchange and Journal of Projective 
Techniques since its first volume yielded but 
a single article [5] devoted solely to card re- 
jection in Rorschach testing, and this was in a 
Swiss journal. Although a number of studies 
have reported card rejection as part of the 
findings, none has been designed specifically 
to investigate systematically the frequency of 
rejection of the stimulus cards. The present re- 
port is presented as an attempt to offer data on 
Rorschach card rejection and its relationship 
to other personality characteristics. 


Research Design ¿ 
Because of the significance and use of ony! 
rejection in interpretation of data gathered by 
the Rorschach method, the present study was 
undertaken to investigate the statistical inci- 
dence of this phenomenon and to seek for cor- 
relative data. The sample of subjects studied 
was a total sample during a two-year period, 
and consisted of 201 patients given psycho- 
logical examinations in the neuropsychiatric 
service of an inpatient hospital. Of the total 
sample, 100 were psychoneurotic (PN), 74 
were psychotic (PS), and 27 were brain- 
darfiaged (OR), as diagnosed, independently 
of the Rorschach data, by psychiatric and psy- 
chological staff members. Data were collected 
on the incidence of rejection of stimulus cards 
of the Rorschach, and on other characteristics 
of the sample studied, including age, Sex, 
Wechsler IQ, education, R.. T/1R, and T/R. 
An analysis of the reaction time characteristics 
and their significance has appeared elsewhere 
[7]. 
Results 
Identifying data and Rorschach response 


characteristics of the subjects studied are 
summarized in Table 1s The differences 
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Table 1 


Rorschach and Other Identifying Variables al 
among the Three Samples Studied 


í R 
F Psychoneurotic (PN) Psychotic (PS) Organic O 
Variable Respond Reject? Respond Reject Respond e 
N 76 24 60 14 17 
A n 40.89 
F Men 30.62 30.64 27.28 28.78 37.53 11,14 
SD 9.60 9.24 11.25 8.78 15.27 
Sex 8 
Male 32 12 26 7 10 z 
Female 44 12 34 7 7 
Education 8.57 
Mean 13.40%% 10.33 12.92 11.03 11.88 113 
SD 2.79 3.78 3.18 4.01 4.30 
IQ (W-B 50 
9 Mea : 113.475% 99.90 104.18 96.00 94.33 T 
SD 12.07* 19.63 17.57 25.17 20.35* á 
R 13.00 
Mean 39.20*% 16.00 55.47%% 19.78 29.88* 437 
SD 21.1498 7.96 50.94% 7.60 27.09** x 
T/R 61.00 
Mean 41.5498 65.33 42.17 72.15 72.76 5 642 
SD 27.86 31.92 24.4248 65.12 49.64 i 
T/1R 
25.54 16.68* 28.24 
19.75 15.10* 22.78 


among the three sa; 
schach response ch: 
identifying data we 
brief, the mean age 
Significantly greater 


years of schooling. Fur- 


n N, age, 
; this raises the Problem of 
characteristics of t 
nificant differenc 


Rorschach responses may possib 


he samples, 


ificantly different at the -05 level, 


+01 level, 


Therefore, a series of correlations was me 
Sary to establish the extent of relations a 
among the identifying variables and the na 
sponse variables. These were computed and ar 
reported in Table 2. fee 

Tt may be seen that in none of the samp i 
did age correlate significantly with other fac 
tors, indicating that this variable probably. wee 
not significant in the varying Rorschach re 
sponse characteristics, though the OR oe 
was significantly older than groups PN ne 

S. However, both education and intelligence 
level did correlate significantly with certain ge 
the other response characteristics, but thers 
was not consistent relationship from Es) 
to sample except between education and I e 
and here the correlations were of the sam! 
order: .63 to .66, There was a positive cor 
relation between education and total number 
of responses (R) for the PN and OR groups 
but not for the PS group; yet only in the lat- 
ter group was there a significant though in- 
verse relationship (7 = —-35) between educe- 
tion and mean time per first response (T'/1R)+ 


s 
La 


> 
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Table 2 


Correlatigns between Variables among the 
Three Samples 


Table 3 
Rorschach Rejections by Sample, Sex, and Card 


Rejections by cards 


Variabl Sample 
e 7 z = 
(N EN 08 ps ae i i > m BE £ 
T =107) (N=29) (N=74) „HHR PEER ng 
Age- 10 —.07 —.16 —.03 Psychoneurotic 
Age-R 22 21 08 Male 41804265415 8 2 
‘A “00 ag —07 Female 6120824818 6 29 
ge- T/R —03 30 a Total 102507497 218 8 57 
Age- T/IR ra = Psychotic 
Age- 3 -06 02 21 Male s8 01020811 4 2 1d 
Educ, ~1Q - —.02 125 06 Female 210002029 0.0 2 8 
Educ.- R -63** .63°* 66** Total 401040541442 
D 4 :2890 Organic 
Edic: AR <a SA m Male wo oaa ga aa 
Educ. = T/IR =F F -00 Female 90002001011 6 
ia aa “ab — 1S «35 Total 70018124065 8 19 
(os ~ 37 09 All groups 
an 32%» 1$ 25 Male 9 1417810 8 218 7 56 
-T —.29% —o7 A Female 6120726719 8 48 
10 T/IR —.23 ee —19 Total 201 2 6 114 61615 32215 99 
R~T/R 07 19 02 
R~T/1R E =80 —22 and individual. Although twice as many or- 
SAT per =u —a7 anics, proportionally, as ps chotics rejected 
T/R .54** 748% 754+ 8 y y ` 
~T/IR oe ae >» cards (37 per cent and 19 per cent, respective- 
T/R-3 «60 60 .70 
T/R- 340" 34 ‘25e ly), and as many as 24 per cent of the sample 
30** 35 13 diagnosed as psychoneurotic, the value of » for 


* Significa 


ne nt at 5% level of confidence. 


Signifi 
ificant at 1% level of confidence. 


Simi 
apo was”no consistency in correla- 
Cation ang pa TQ and factors other than edu- 
only eee IQ ere were significant correlations 
mene O Bend 1G = T/R te e PN 
were a i of the 63 correlations 19 
level of si cant, 16 more at the $ = .05 
rom cha ignificance than would be expected 
Mice, 4, variation alone (see Table 2). 
sistently y 1 h relationships did not appear con- 
is ap paan ough the relative significance of 
Elaa a m the 7 of the 19 significant cor- 
and in fe which R was one of the variables, 
factor. Ti 8 correlations in which time was a 
relation urther, 10 of the 19 significant cor- 
Fema occurred in the PN group, with the 
the ie 9 about evenly distributed between 
relative a e groups, suggesting the greater 
ables in order of relationship among these vari- 
Serious] neurotics as compared with the more 
chotic = pontistent individuals of tue psy- 

Ta Tabl organic pathology samples. 

on Ro ables 3 and 4 are presented the data 
sampl rschach card rejections 1n the total 
Ple, tabulated by disease category, Sex, card, 


the chi-square statistic was between .20 and 
.10, not significant at the usually accepted 
level of .05 or lower. The mean number of 
cards rejected was variously 1.64 (PS), 2.38 
(PN), and 1.90 (OR). Among the 201 pa- 
tients in the total sample there were 99 rejec- 


Table 4 
Rorschach Rejections by Sample, Sex, and 
Individual 

Sample and N Frequency of rejection Total 

sex 1 2 3 4 5 6 persons 
Psychoneurotic 

Male 4 25 122 0 il 
Female 5% 6231021 13 
Total 10 8 743121 24 
Psychotic 

Male 3 4021 7 
Female 44 5 2B 10 20 7 
Total 74 9 2-21 @ dt 
Organic 

Male is 4 0 1 7 
Female OW a oO 1 0 3 
Total 27 66 © 3 10 
All groups 

Male 95 10 5 3 4° 1 OR 
Female 106 13 441 0 2 23 
Total 201, 23 94,9 6i EE 
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tions of stimulus cards by 48 individuals, a 
mean rate of 2.06 for those who did reject. 

ese rejections were Principally of cards IV, 
VI, VU, IX, and X. Similarly, Klopfer and 
Kelley [6] reported rejections most often of 
cards II, IV, VI, and IX. In the present study 
24 per cent of the total sample rejected cards, 
50 per cent of the stimulus cards provoked 83 
Per cent of the rejections, and in these rejec- 
tions 23 of the 48 Patients rejected only one 
card and only two rejected more than four 


repect to age and sex. O 
able, only the PN gro 


c Sof .63 to -66) for each 
moe three diagnostic samples, only among the 
op aia the responding patients have 


C expected. How- 
a Pages differed significantly among 
0 e and OR ir 

teed Samples, but in reverse 


means and sigmas in the analysis of q 
the T/IR variable, alin 


Ivan N. Mensh and Joseph D. Matarazzo 


Summary 


Rorschach card rejection has been disered 
and reported since the introduction of the TO 
schach technique for psychodiagnosis. Di A 
ential significance of the phenomenon E a F 
rejection frequently has been Suggeste hye 
diagnostic aid, but a systematic study o oe 
statistical incidence of this behavior has a 
been reported. In the present study, a ‘ha 
Pitalized patients were examined wit ae 
Rorschach method. In the total sample a 
were 100 psychoneurotic, 74 psychotic, an € 
brain-damaged patients. The three groups Pr 
not matched but represent a typical sample 6 
patients seen in clinical psychologic practice # 
an inpatient service. Intercorrelations ana 
variables representing sample ee 
Were not consistent, but suggest that the re psi 
tive order of relationships among these charac- 
teristics in neurotics is higher than in the yor 
ples of the more seriously disorganized n 
tients diagnosed as psychotic or brain-damage h 

Rejection of one or more of the i 
stimulus cards was found in 19 to 37 per el 
of the samples; five of the ten cards poyok. 

3 per cent of the rejections; in the repona 
of subjects who rejected the cards, on the a 
erage, two cards were rejected per patient, T 
though about half of the rejecting individui 
rejected but one card and in only two a s 
were more than four cards rejected. A num i 
of trends that differentiated patients TEAT 
ing to all of the stimulus cards from ee 
jecting one or more of the cards appeared, e 
there were few Statistically significant i 
ences. As in an earlier study, the major fna a 
w'th respect to Rorschach card rejection is 4 
extreme variability in response charai 
emphasizing again the care necessary in ne bd 
ing data gathered by the Rorschach meth 
to interpret behavior. 


Received O-tober 20, 1953. 
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Cerebral Palsied Children’ 


David H. Crowell 


University of Hawaii 
and Doris C. Crowell 
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t 
as severely retarded. Analysis of the total or 
results showed that Raroziptily I pe I 
of the total group deviated within iae 
» Were points of the initial test score and ag ‘lie 
ly 75 per cent within + 10 IQ points of re 
ycholog- initial test score. Pearsonian ee Bete 
Individual liability, based upon mental ages, an fol- 
dence limits at the 1 per cent level are a ae 
ell as mus- lows: Group I, r = + .98 with ere 78 
7 Examinations, ranging limits of +.94 and +.99; Group II, r= 91 i 
from 2 to 6 per indivi with confidence limits of + .52 and + ce 
i and total group, p = + -92 with contidenos 
} limits of + 87 and + .95, Standard wares 
nce Scale, 11 cases; and the Merrill-Pal- estimate are, respectively, = 7, + 13, and ahs 

ler case. Seventeen The data Suggest that the mental a cal 
involved in 46 tained on the initial examination of a cere! 


Health, Honolulu, Hawaii, and the Ps 
ical Clinic, University of Hawaii. 


diff 


y 5 iable 
© examiner in 15 cases palsied child can be accepted as ytre 
Based upon the median of all test-retest in- for ordinary diagnostic PUNDOSES; _DLOVICE! 
ae two groups were formed: Group I, 16 
males 


$ ; ining and 
clinical psychologist has adequate training a! 


experience. If errors of clinical judgment A 
test interval of 15 months, and Group II, 20 the initial examination occurred, they erred ie 
mares and 13 females with an average test-re- the side of caution, Moreover, these coe i 
fest interval of months. The total group cients of stability are highly significant and hav 

ad an average test-retest interval of 30 wide generality since there were per CE 
months chances for the operation of errors inherent 1 a 

This sample was highly skewed, with tile measuring instrument, errors due to clini 
roughly 50 per cent of the grou 


k ; 5 u- 
P classifiable cal Judgment, and errors resulting from fluct' 


ions i ili 3 uration. 
i y may be obtained ations in ability because of mat 
ment of Psychology, Une wvid ms Cro ell, Depart- Brief Report. 
versit ii A 
14, awaii, or for a fe then Honolulu 


2 i Received March 1, 1954. 
mentation Institute, To obtain it PERUN Docu- ee 


Tom the Jat 
Document No, 4287 from ADT wi Reference 
ary Publications Project, Photoduplicat n Service i dy of 
ibrary of Congress, Was ington 25, Pe e R Jorgensen, Margaret. A comparative stu Tii 
$1.25 for pa yance ea 35 mm, Microfilm or the Stanford-Binet Form L and the paar 
Pl. ication ery take checks pay abt i ite Binet. blished master’s 
Plotoduplication Service, Library of Canero Hes Tamosite. Binet Mapobtishe 
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Rorschach Adjustment Scale 
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and Harold F. Uehling 
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Am ee 
echeck the objective scales based on the 
Buhler rey Dar are those constructed by 
Hughes 16] avidon [2, 3], Munroe [9], 
ees ave of 0a Piotrowski LLO]; The first 
tempt to le mien interest since they at- 
Scales were Pecan general adjustment. ‘These 
ciples emplo ST along the general prin- 
two Sa y objective test constructors: 
terms of pip igen to be different in 
Signs were fee Te were established ; various 
ative powers; ed to determine their discrimin- 
Significance ot ae that met certain limits of 
Were then ¢o = ifference were isolated, and 
ever, the a pace to form the scale. How- 
ÈS its ability Hag test of the value of any scale 
ulations, y to discriminate between new pop- 

Th 

aN — this study is to test the 
he Davi a or generality of measurement. 
reasons: first Figs was selected for several 
GORGE Case eee limited to 17, 
Score them: se e so objective that a clerk might 
lone with Pitot previous research has been 
liable [2 3] is scale to indicate that it is re- 
strated ca bl third, the scale has been demen- 
pable of differentiating between “ad- 


Justed” F 
[2 5,8 ae maladjusted” school children 


3 


Dhs obia 
of sig itification of the Rorschach by lists 
Potheses te Purposes: (a) validation of hy- 
Possible See to various signs, aud (b) the 
maladjustment te arious degrees of emotional 
Renerally dubi ost Rorschach workers are 
Scales, belieyi ious about the value of such 
reveal uni aoe that projective instruments 
ality and dhe and ineffable aspects of person- 
qualitative at the quantitative conversion of 
little of aspects: of the personality yield 
extra value. However, it is possible 


that objective procedures have some value. 
For example, in comparing two clear-cut pop- 
ulations, one “normal” and one “abnormal,” 
if it is found that differences with regard to 
any sign are nonsignificant or even in a direc- 
tion not predicted, then the clinical insights 


that suggested the interpretation of these signs 
may be questioned. 


Method 


The two populations are called “Guard” and 
“Inmate.” Both consist of males, matched for 
Since it was not possible to match for ia- 
telligence, only protocols of inmates who wire 
known to have at least average intelligence 
were selected ; also the guards had the equival- 
ent of high school graduate standing, and were 
presumably at least average in intelligence. The 
guard population is composed of men accepted 
as probationary prison guards at the Wiscon- 
sin State Prison at Waupun. They ranged in 
age from 21 to 45, and were of undamaged re- 
putation. Each probationary guard had passed, 
in addition to the usual civil service require- 
ments, the criterion of an interview by the ap- 
pointing authorities. Therefore, they form a 
screened population since people who would 
appear unsuitable in terms of personality de- 
fects or handicaps of adjustment would not 
be hired. No evidence exists to support a be- 
“lief that this group as a whole differs from any 
normal sample of the adult snale population. 

The inmate population consists of men com- 
mitted to prison for felony crimes. This alone 
might be considered to be presumptive evidence 
that the group as a whole is abnormal, but the 
population actually subjected to the Rorschach 
‘was a selected sample of this larger grouP- 
Only those inmates who, in the opinion of a 


age. 
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psychiatrist, appeared seriously emotionally 
conflicted were referred to the psychologist for 
Projective analysis, Therefore, the sample of 
inmates who were matched for age against the 
guards was doubly distilled for abnormality: 
first by the court, and second by the initial 
psychological and psychiatric examinations. 
All Rorschachs in this study were adminis- 
tered by Uehling, Analysis was done by both 
writers, and for the two signs that called for 
judgment, no color shock and no shading shock 
(signs 15 and 16), independent evaluations 
were made. If agreement did not occur, the 
Protocols were examined more carefully until an 
agreement was reached. The analysis of the pro- 


Currence of the Davidson 


centage of the difference from Edwards’ 
mula 21 [4, Pe 77}. 


A 3 5 
Sign & = t $ 
5 6 

1. M > FM or M=FM 26 27 02 

2. M, 3 or more 8 13 123 i 

3. Sum C >Fe+e¢ a Ge 30 21 1.30 a 

4. Fh — 50 to 20 21 18 7 ; 

5. Dd+g 10% or less 32 34 Te 

6. P, 4 or more, up ae 

to 30% of R 

7. R more than 20 a $ i i 

8. FCX GF or FG CF 25 26 ‘02 s 

2. BCZ ot mora 21 30 139 3 
10. No pure C 23 31 L6 ; 
11. %8, 9, 10-40 to 60 17 14 pe F 
12. FK + Fe, 2 or more 12 u ‘02 s 
13. W:M =2:1 12 9 75 ‘5 
14. A% 50 or less 30 37 149 2 
15. No color shock 233i 1.61 5 
16. No sħading shock 37 34 75 A 
17. No refusals 35 45 250 ‘02 


Raymond J. Corsini and Harold F. Vehling 


also calculated. 
Results . f 

Table 1 lists the 17 signs, the frequency be 
“their occurrence in both groups, the z tes d 
and the levels of significance. It will be ae 
that 14 of the 17 signs are in the expected k 
rection. However, the “abnormal” popula aoa 
does “better” than the “normal” population 
on signs 3, 4, and 16. Sign 3, Sum C greai 
than Fc plus c plus C’, is significant at ae 
10% level. Of the remaining 14 signs, eons 
are insignificantly in favor of the „norm e 
group. Sign 9, FC two or more, is so 5 
at the 10% level, and sign 17, no refusals, 
significant at the 2% level. ie 

The mean Davidson score for the 50 Ta 
mates is 8.24 + 2.32, and for the guards it 
is 9.08 = 2.36. The difference of 0.84 is 71 
nificant at the 10% level with a ¢ of 1. e 
These figures compare favorably with th 
Scores reported by Davidson for various PE 
ulations [3]. The only adult norm is 10) 
Seven college students, given as 8.14; this 
score is nonsignificantly lower than both our 
inmate and guard nezms. 


Discussion 


Scales may be restricted to special popula- 
tions. While a scale for length is general for 
any object, psychometric scales may be T 
cific. Thus an intelligence test may be suitable 
for only a particular population, and scales for 
measuring general adjustment with the Ror- 
schach may be restricted in their applicability, 
In the case of the Davidson scale as applic 
to our populations, 14 of the 17 signs are 1n 
the expected direction, but of the three 
mieet the 10% level of significance, one o 
them is in the wrong direction. Only one sign, 
number 17, no refusals, was significant at be- 
yond the 5% level. Whereas only 10% of the 
guards had any refusals, 30% of the inmates 
refused one or more cards, 

The scale as a whole measures in the expect- 
ed direction, but not to any significant degree. 

he gain resulting from using this scale is 
minimal. We could expect to select eight fewer 
guards and eight more inmates out of a pop- 
ulation of 100 guards and 100 inmates than by 
chance if we were to use this scale for selec- 
tion purposes, This is certainly no impressive 
Saving over chance. 


Cross Validation of Davidson's Rorschach Score “ 


a p Future Research 
on ae a [12] using the same pop- 
anne ir ` iscovered that while the re- 
not differ si E e inmates and the guards did 
fterei if cantly from each other, both 
reported be : icantly from the reaction times 
the differs: anderson [11]. The reason for 
oie ibn was stated to be the reluctance 
atenen = = inmates in contrast to the 
this probabi anderson’s group. However, 
line to a. e reluctance should not be ger- 
lt ts TE arg investigation. 
criminative ¢ s in the future to check the dis- 
in. setaeete ay of other scoring schemes 
to determine ri populations; and, in addition, 
aided, to se e ability of psychologists, un- 
parate the two groups. 


Summary + 


The 
ine iah protocols of two populations 
Were analyzed 7 color, age, and intelligence 

avidson Ro 5 terms of the signs on the 
Population pin ach Adjustment Scale. One 
Suards who ee of probationary prison 
routine of ook the Ror$chach as part of the 
“normal.” AE ection and are considered to be 
Prison inte ather population, consisting of 
Screened by ne convicted of serious crimes, 
Jective tee psychiatrist, and referred to pro- 
ality dif ing in terms of suspected person- 

f eee is considered “abnormal.” 

i Davidson signs, only 3 were sig- 


nificant b 
“wrong” AEDE the 10% level, 1 of them in the 
Was sj ection, Only one sign, no refusals, 


as signif; 
asia He beyond the 5% level. The scale 
Setting a pele significant at the 10% level. By 
over chance ing score at 9.00, an 8% saving 
© too small Soe, which is believed to 
o warrant the use of this meth- 
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od for the purpose of separating adults in 
terms of personality maladjustment. 


Received November 30, 1953. 
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Failure to Return for Treatment in Tested 
and Nontested Clinic Patients 
Miriam McCue, Morris Goodman,? and Melvin Rosenthal’ 


VA Mental Hygiene Clinic, Lowell, Massachusetts 


When new clients fail to return to a clinic 


for treatment after they have been psychologic- 
ally tested, it is 


not uncommon to assume that 
the tests were “too threatening.” 

© test the validity of this assumption, the 
following hypothesis was formulated: Giving 
Psychological tests to patients when they first 
come to a clinic has the effect of increasing 
the incidence of failure to return for treat- 


A brief battery of tests was 
clients who reported to an out- 
during a six-month period. The 


given to all 
patient clinic 


ntake testing,” 
The Ss in a 


ll groups were 
World War II veterans who liy, 


‘brary of Congress, 
advance $1.25 fi 


: or microfi] 
or $1.25 for Photocopies. Make checks payable m 
Chief, Photoduplication Service, Library of Con- 
gress, 
2 Now at V. 


A Mental Hygiene Clini 
New Jersey. c, Newark, 


3 Now at VA Hospital, Brockton, Massachusett-, 


in which the clinic is located, or in crs 
communities. Their ages ranged from 23- tee 
Only one (5%) of the tested Ss did oe eae 
turn for treatment, whereas in a ae 
trol groups six and one Ss, pom nak 
11% of the combined control group, al ont 
return. Thus the hypothesis is not borne dss 
Fewer of the tested Ss than of the nonteste nce 
failed to return for treatment. The ae 
is not significant, however, and the dire can 
it takes could have occurred by chance varia 
in the sampling of patients. salu 
Length of time in treatment may bein 
enced by many factors, of which testing 13 t 
one. If the testing siżuation was threaening He 
Patients when they first came to the P a 
the Ss in the experimental group should hort 
shown a tendency to remain in therapy as al 
er time than the control Ss. An inciden a 
finding of this study does not support of 
second hypothesis. The median number a 
times the tested Ss returned for treatment os 
10, while the medians were 8 and 7.5 rg 
tively for the other two groups. agan ais 
trend seems to be the reverse of the hypot rr 
However, the difference between the Ao 
and the experimental group medians was ent 
significant, and therefore time in Leet 
in terms of therapeutic interviews, does Mea 
differ significantly for the tested and the n 
tested Ss, F 
Apparently the testing at this linie m 
not threztening enough to deter the pa $ 
from returning for treatment, or to ge rN 
number əf their visits. The effects of ” 
ferent tests, different examiners, and differe 2 
theranists remain problems for further T 


_ Search, 


Brief Report 
Received May 3, 1954 
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An Evaluation of Psychological Reports 
In a Clinical Setting’ 


Sol L. Garfield 


VA Hospital, Downey, Illinois 


Ralph W. Heine and Morton Leventhal 


VA Mental Hygiene Clinic, Chicago, Illinois 


he elint 

arge pial Sprout currently spends a 
ogical tests to is time administering psycho- 
tensive report patients and writing fairly ex- 
are usually s of his findings. These reports 
conference ag at some form of staff 
Case file of th later are incorporated into the 
Permanent se patient, where they become a 
ee oe Although the 
summary of ‘ee report represents the final 
ation and is oe psychologist’s clinical examin- 
to the total Fi as his unique contribution 
Comparative] aS study of the patient, 
the literatiire, ittle discussion has appeared in 
ty. Furtherm concerning this important activi- 
cerning fe mca while a few accounts con- 
reports have idbire and form of psychological 
ations of a peared [1, 2, 3], critical evalu- 
ligible,? Be rent report writing have been neg- 
area of Ss cons of this lack in a significant 
Was deemed ychologist’s professional work, it 
tempts of worth while to report on the at- 

one clinic’ to evaluate critically the 


Psychologi 
so, nological P 5 
tivities of the on orts used in the daily ac- 


The Present Study 


The 
ized Si sa for the present study was recog- 
ary staff di sult of the regular interdisciplin- 
Of these oo at the clinic. In the course 
eetings, various dissatisfactions with 


From th 
e A 
VA Regional Gipo Rital, Downey, Illisvis and the 
The fist: beak no Micago, Ilinois. 
far, Published ok on writing clinical reports i] 
a as this manuscript was being pre- 
: epis 
ki whick ie reported here was a cooperative one 
Ane linie, ae members of the VA Mental Hy- 
to bors wish to icago, Illinois, participated. The 
W than especi acknowledge this participation and 
cotkins, and ially Drs. D. G. Wright, John G- 
mpletin Miss Clara Weimer for their aid in 
E the project, 


the psychological test report were voiced. The 
most important criticisms dealt with the mean- 
ingfulness of the psychological report and its 
general usefulness. As a result of these staff 
discussions, the psychologists were stimulated 
to explore the problem at greater length, and 
a more formal investigation was undertaken 
in the hope that a better evaluation of the 
problem and some specific guides toward im- 
proving the psychological reports might be ob- 


tained. 


Procedure Š 


The procedure eventually decided upon ws 
to select a one-month period far enough in the 
past to avoid ready identification of the author, 
but recent enough to be representative of cur- 
rent psychological reports. All the reports writ- 
ten during this month, 16 in number, were 
stripped of all identifying data and constitute 
the material upon which the present study is 
based. 

The reports were then numbered from 1 to 
16. The numbers were placed in a hat and one 
of them was selected. Copies of the report 
bearing this number were then typed and dis- 
tributed to every full-time professional staff 
person in the clinic. In addition, tke remaining 
15 reports were retyped and distributed in a 
random fashion to the clinic staff. In this man- 
‘ner, each staff person was given two psycho- 
logical reports in a blank ervelope anu asked 
to evaluate each of the reports and assign a 
letter grade to it. The evaluations were to be 
done anonymously and returned to a secretary- 
The only identification on the envelope related 
to the professional group to which the s 
inember belonged. In this way we were able to 
compare the evaluations of psychiatrists, psy- 
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chologists, and social workers as a group. Spe- 
cific written instructions were included as fol- 
lows: 


Your cooperation and participation is requested 
in this survey (anonymously). The Psychology De- 
Partment believes that by securing independent eval- 
uations from the various members of the staff re- 
garding Psychological reports, it will be possible to 
incorporate many valuable suggestions to the end 
of better service in the diagnostic area, 

In order that there may be specific remarks with 
which we can work, each participant in this survey 
is being supplied with two sample reports, one of 
which is being evaluated by everyone. There are wide 
margins where any notations or remarks may be 
made regarding the adjacent Paragraphs, phrases, 
etc. The remarks may cover any aspect, from the- 
feel free to cover any 
the reports used have 
e referrals over a one- 
en written by all mem- 


for purposes of tracing them back to the original 
testing material, 


Please give a letter rating at the top of the first 
Page to indicate the over-all quality of the report, 


e/a A, excellent; B, good; C, fair; D, Poor; F, 
very poor, 


_ The Teports were then given to 9 psycholo- 
gists, 13 Psychiatrists, and 


11 hiatri i 
ROL AN co Ge psyc latric social 


written evaluations, Thus, the 


of evaluations, No attempt w. 
Specific questio 


re were 32 sets 


Sponse, and w: 


matter as un- 
Structured 


Although this proced- 


s were collected, the 
a research team to an- 
of the three authors 
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uniform method of recording the responses to 
the test report. A check list consisting of six 
categories with 24 items was then pr epared a 
use in reordering the data in a uniform oe 
meaningful framework. The common eet 
was again reappraised independently by a 
three investigators in terms of this mora 
It was decided at that time also to apa: 
a specific comment or criticism only one 
for each person. For example, if a a 
pant made the same criticism of one se 
port a number of times, it was recor a 
only once. This step was judged necessa : 
to compensate for the variability among 
the written comments of individual staff mon 
bers and as a check against distorting the sE 
nificance of specific comments. Thus, if e 
person made the same criticism 10 times, 
would receive the same weight as a gener: i 
criticism made once by each of 10 different D 
dividuals. As a consequence, the unit used paa 
the number of individuals making the com 
ment rather than the actual number of times 4 
criticism was made. i f 
After the second ‘independent appraisal 2 
the responses to the common report, the uo 
ers reassembled to discuss their findings HE 
plan for the final recording of the data. T 
final recording and tabulation of responses t 


: a 
all reports was then made by the writers as 
team. 


Results 
= > e- 
The letter grades giver. to the common al 
Port are summarized in Table 1. In general, 


Table 1 
Grades Given to Psychological Test Reports 


Common report 


Grade Psychol. Psychiat. Soc. wis: 
A T T 
B 3 7 A 
c 5 1 A 
D & below 2 
Total 9 11* ua 
2 Other reports 
Grade Psychol. Psychiat. Soc, wire 
A- "z 0 y 
B 2 1 3 
c 4 7 2 
D & below 1 4 l 
Total 9 12* 1t 
MORe Psychiatrist submitted written comment but 


Omitted a grade for the common report. 


Psychological Reports in a Clinical Setting 


a ‘eed judged to be satisfactory or bet- 
a S — ee were inclined to rate the 
sia eon A igher than representatives of the 
om = inic disciplines. While the median 
oF te os t E sc eae was higher than that 
Baye E ychologists, the only participants who 
ateisi ee a rating below C were psychi- 
varinbili: is finding may indicate a greater 
Ep i the evaluative attitudes toward 
The aan test reports held by psychiatrists. 
ee fa ne es given for the other reports dif- 
i er te £ ways from the distribution ob- 
Se mest common report. In general, the 
Sider: — and psychiatrists gave lower 
Paré where se peponi than to the common re- 
sentially si a he psychologists’ grades were es- 
Sere sche =a in both instances. Since there 
conclusions ifferences in these reports, no firm 
are dosed be reached, but certain trends 
evaluated A e. In terms of all the reports 
Breatest 4 a psychologists demonstrated the 
tended oe ility of ratings, the social workers 
© give the most positive evaluations, 
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and the psychiatrists the most critical evalua- 
tions. This trend was also apparent in the 
qualitative comments made for each of the test 
reports. 

As indicated previously, some difficulties 
were encountered in trying to order the spon- 
taneous comments of the staff with regard to 
the psychological test reports. We purposely 
wanted a free expression of opinion. However, 
since the verbatim responses varied greatly, 
some way to group the data was necessary. The 
particular classifications finally used are given 
in Table 2. Attempts were made to use the 
actual verbalizations and meanings as sub- 
headings as much as possible to avoid misin- 
terpretations of the data. Undoubtedly some of 
the categories overlap, and some of the differ- 
ent groupings may in part reflect specific ori- 
entations of each professional discipline. 

As we have organized the data, the critical 
comments fall into four major categories: (a) 
lack of behavioral referents or supporting data 
for statements contained in the reports; (b) 


» Table 2 ö 
À 


Evaluative Responses to Psychological 


Common test report 


—— a e ËS z 
Categories a we Bo a ase #98 #2 S 
evaluati gories of da E >] a5 | E i Ei aF i 
ive responses = |l 5 Il 3 Il Fl 3 3 aL Be 
eee gz cS ge BS ez Al gS FY 
b 


Test Reports 


Other test reports 


Lack 
X of Supporting data or 
e paal referents 0 
ehavioral ref 6 , ? 
he Speculative ia : ; , 
: Supporting test data p ; i ; : : 
OF expression : 
se of clichés, ; 2 : 3 2 
OSE use of oe ; 0 : : 2 
ague and unclear 4 0 d A 2 2 : 
°orly expressed 4 0 0 ` . Í ' 
O 
No organization 
Integrated pj i o z , ) | 
Pict i 
a oorly organized i g jk ' , i 
tscellaneous 
eniten 3 | 
eect use of theory É ' ' Í 
A ata not differentiated s 
tee other data , 3 ! : l : 
ao Unconscious sound 
dear ious i 0 2 2 
w it answer referral problem : ; 0 a : 3 
ong and irrelevant g ° i i ; ; | 
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general lack of clarity of expression ; (c) poor 
organization; and (d) miscellaneous observa- 
tions. The first two categories appear to be the 
most significant in terms of the qualitative com- 
ments received. All of the categories, however, 
will be discussed briefly. 

The psychologists reacted most critically to 
a lack of specific behavioral referents, i.e., in- 
dividualized examples of very general state- 
ments made in the test reports, For example, if 
a patient was characterized as anxious, de- 
Pressed, or immature, they wanted to know how 
this was manifested behaviorally or what the 
significance of the trend was for the specific pa- 
tient. Two excerpts from one of the test Te- 


ports that exemplify this deficiency are the fol- 
lowing: 


He has little ability to delay gratification through 
the medium of mature fantasy activity and thus re- 
sorted to immature, wishful inner living. 

There is little hazard of the patient acting out 
since there is a paucity of inner resources, 


These statements, 
translation into term 
bavior, irrespective 


ee, a | to evaluate along with 
ti S ; 
the © gnostician the “hazard” of this Patient’s 
acting out. 


Speculative” 
al comments 
ollowing: Al 
unge into interpre- 
onclusions without 


ng data. Typic 
in this general Category were the f 
object to this immediate pl 
tations, speculations and c 
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citing test data highlights for each of the con 
administered on which to base opinions. : 
what is this speculation based? .. . Data, i 
least some, are essential to evaluate this pea 
ulation.” “What evidence is there for this in 
terpretation?” “There is a tendency too oien 
to accept certain hypothetical dynamics as ta F 
and base conclusions on such theoretical on 
clusions.” “Again, suggest at least some baste 
data as obtained and separate from pine 
ton and/or speculation.” One final illustr: ; 
tion is offered as an example of what we cong 
sidered a conscientious appraisal of the report: 


; d 

This portion gives the impression of being mice 
on test results; however, the following fact Seat 
leave such an impression but Suggests instea Nee, 
test material was used as a take-off point ee 
flight into the type of speculation that suits be 
aminer’s system of Psychological thought. Per the 
the means to avoid such impression might be a 
use of examples from the test material wherev ” 
Possible, e.g., “as evidenced by,” “as reflected in, 


etc, to distinguish the demonstrable from the sup- 
posed, 


There was little. question that the porchi 
atrists judged these kinds of criticisms to 
among the most important. Such erie 
were also offered by approximately one fourt! 
of the social workers. The reasons for their 
skepticism are not readily discernible, but it 15 
worth “speculating” about them. It may be 
that the reports appeared to be too inclusive 
and that they doubted that such complete por- 
trayals of Personality could be obtained solely 
from test data. Another consideration may be 
the tone of finality evident in many reports 
which also tends to stir negative reactions. Un- 
doubtedly, other more obvious factors are also 
involved. Very evident inconsistencies, state- 
ments which contradict other data, and similar 
factors may have tended to undermine confi- 
dence in the reports and to cause one to view 
them with suspicion, Whatever the factors may 
have been, the net result was to limit the ac- 
ceptance of the test reports, 

The criticism of lack of supporting data was 
also accepted. by many psychologists with some 
Teservations. It is often difficult, if not impos- 
sible, to present evidence succinctly since 1t 
comes from a variety of test data. Moreover; 
Psychologists may have some legitimate doubts 
that members of allied professions are equipped 


. -Ia eee 


ee 


Psychological Reports in a Clinical Setting 


to inter . 

Ea evidence which is presented. 
general im ie this problem may depend on a 
ing with p i Paha in psychological report- 
Certain ki aps some supporti i 

i kinds of eee ting ee 

© secon ; g 
Sponses rie pa category of critical re- 
and careless Š > COEDEN pertaining to poor 
Tepresentati expression. The following are 
ose use of € comments: “vague, unclear, 
. , ? 
stand, IN Doaa pure jargon, don’t under- 
Bory conan expressed, etc.” While this cate- 
Ne first iao ly overlaps with statements in 
Phasis in the 7 subdivision, in general the em- 
Clarity in n grouping was on lack of 
and the use of a poor communication, 
a 3 
ob: ere was no ‘= ie gangon: 
obscurity, and ack of examples of vagueness, 
the repo overdependence upon clichés 
Wotati orts examined. TI F 
A ions in which the “ he following are 
7 ” 
S are self-evident: he “sins” of the psycholo- 


T j 
Pae entile trend 
resid T asam 


ual 
‘phere, 


S ar i 

Citi E: He employs reaction 

tensions eriy control but there are strong 
Strive for access to the motor 


A wit epee resources remaining, 
dysphoria and anxiety. 


7 ere į . 
ance e is eyid 
0: . enc . Pee . 
k genital RS some dissociative disturb- 
A € att i 
18 ẹ; “attempts 
XPerie to be orderly, to draw closure on 


tivit nces whi 
in that he etica] sg to limit spontaneous ac- 
Y over Bas regress aoe characterize his behavior 
Presseq oae on ee | Psychosexually, is emotional- 
ost aeaa a ices level and has re- 
e impulses. 


n the thi 
i Diajorite a tegory, “poor organization,” 
a peep referred to the follow- 
iscuss ee the part of the diagnos- 
ailuy, Or sectio ated findings in the same 
atao 2 constru n of the report; and 
Sep, Various as ct the report in such a Way 
fer ately Were fn of the personality discussed 
Picture of th nally integrated into a uni- 
ty. Pca tinali of the patient’s 
is latter a ogists, primarily, were crit- 
ei the final spect of the reports. 
included category of misce!laneous items 


Ory ed: 
(a) observations of contradict- . 


Stat 
the ments whi 
hich occurred not only within 


€ repo 
rt : aegis . 
cian nce; but occasionally within a single 
clea: E E where the diagnosti- 
not understand the personality 
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theory that he was employing as a guide for 
his interpretations ; (c) comments noting the 
inclusion of what was obviously social history 
data as a test finding; (d) statements con- 
cerning the length of reports and the failure 
to answer the referral problem; and (e) crit- 
icisms about “making the unconscious sound 
conscious.” The latter referred to personality 
s that sounded as if the individual 
lanned his behavior in the 
“since he could find no 
fying his needs, he re- 
means of obtaining 


description: 
patient consciously p. 
manner described, €g. 
mature means of grati 
sorted to somatization as a 
gratification.” 

The matter of inconsistency was not limited 
but in some cases was a re- 
al use of test terminolo- 
pts. An example of the 
latter is evident in the following comment: 
“How can he [the patient] be ‘affectively im- 
poverished’ and at the same time show ‘height- 
ened dysphoria’ and anxiety — do not the lat- 
ter indicate capacity for affect?” 

The critical comments on the length of rez 
ports were made by approximately one thi’ 
of the staff in reference to reports other th 
the common one. Whereas the common report 
was two pages in length, the other reports 
varied from three to five pages, and this fact 
may account for the relatively lower ratings 
given to these reports. These findings would 


imply that a concise report more specifically 
directed to the referral problem is much better 
n a long rambling one that at- 
t an all-inclusive personality 


to any specific area, 
flection of an uncritic: 
gy and clinical conce 


received tha 
tempts to presen 
description. 
Finally, it should be 
e, as might be expec 
cisms of grammar, S 


structure. These, however, were sufficiently 
o warrant bare mention 


limited in number as t 

here. Also, a number of favorable comments 
were made, largely by the social workers. This 
finding seems consistent with their tendency te 
be less critical and in general to give higher 
evaluations to the reports. The positive com- 
ments were such as to add weight to the cate- 
es of criticism shown in Table 2; that 1) 


f bly for being “con- 
d favorably i, pees a 


The term 


mentioned that there 
ted, scattered criti- 
ish” and sentence 


gori 
reports were Viewe orably 
cise,” “clear,” «well written, an 


answering the referral quótion- 
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“good” was used relatively often with no speci- 
fic reason given for its use. Perhaps one quota- 


tion might help indicate some of the bases for 
favorable reaction, 


I feel that this is an excellent type of report prin- 
cipally because the language is Simple, i.e., non- 
technical, and the construction is direct and to the 
point. The “lay-out” too is good. 


Summary and Conclusions 


A one month’s sample of psychological test 
reports was distributed to all Professional staff 
members in the mental hygiene clinic for their 
critical evaluation, All identifying data on the 


Teports, while the 
critical, The psyc! 
criticized the reports 
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ents for generalized statements made in the re- 
ports. They were also sensitive to the use of 
clichés, technical jargon, and the lack of clar- 
ity in several of the reports. In general, the 
main criticisms of the reports were related to 
the lack of supporting data or behavioral ref- 
erents and to a lack of clarity and concise com- 
munication. 

On the basis of this pilot study, it appears 
that if psychological test reports are to be more 
useful they should be as concise as possible, 
avoid generalities and the use of technical m 
gon, give supporting data for certain kinds “i 
inferences, avoid “speculative dynamics, an 
try to give a portrayal of a specific individual 
using behavioral terms wherever possible. Part- 
ly as a result of this study, the staff psychol- 
ogists at the Chicago VA Mental Hygiene 

linic are revising their style of reporting psy- 
chological test data. 


Received November 5, 1953. 
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Some Common Misconceptions 
About Neuroticism’ 


Harrison G. Gough 


University of California, Berkeley 


A 
Needs Pm — science of psychopathology 
4 thorough se upon, among other things, 
Particular belie f accurate knowledge of what 
udes, and self S, values, self definitions, atti- 
, Persons di conceptions are characteristic 
®tles about agnosable as maladjusted. The- 
Motivations Process, about the “self,” about 
can hardly 3 and about therapeutical techniques 
Pre-establishmn evolved without some minimum 
We te de oe of “facts” in this realm. 
= cory a example, if one is to develop 
Most neuroti account for the contention that 
Tom life ti say that they get a “raw deal” 
Most teeter we must first make sure that 
t is Sather do, in fact, express this belief. 
chological 1 „Surprising, if one reviews the 
iscover how ae of the past 20 years, to 
e characters ittle has been done to determine 
nd attitudes oe and differentiating beliefs 
© their Sayels pene classified with respect 
Some general ological adjustment. We have 
ics feel ies no en for example, that neurot- 
Bing Ka erstood, that they often have 
What they d that they often expect to fail in 
than Shey: o, that they desire more sympathy 
trate, wl ges that they find it hard to concen- 
Usion of ‘des forth. Yet, 'in spite of the dif- 
ew studies mere as these, there are only a 
Or responses Ic have actually asked patients 
the frequen on these issues and then,compared 
of control oa agreements with those 

e . 

few studies done, such as those of Page, 


Landis, K 
» Katz : A 
away and atz, and Zubin [6, 7, 10], and Fath- 


Dsy, 


Thi 

1s roj 

grant aaa dee conducted under a research 
ational Institute of Mental Health, 


ation: ati 
e Institutes of Health, U. S. Public Health 


McKinley [4,'5, 8], have revealed . 


findings strikingly discrepant from the perva- 
sive stereotypes of both professional and lay 
persons. The clinical stereotype about what 
patients would say and think appeared, in both 
series of studies, to be so wide of the mark as to 
lead not only to irrelevant designations, but to 
erroneous ones. For example, in one paper of 
Page, Landis, and Katz [10], a 50-item scale 
for schizophrenia based on expert psychiatric 
judgment actually yielded higher scores for 
a control sample of nonhospitalized adults than 
it did for a group of diagnosed schizophrenics, 
Clearly something is amiss in the clinical co 
ceptions of verbal behavior in peas 
if errors of this magnitude can appear. 

None of the studies mentioned, however, 
was primarily devoted to specifying and out- 
lining the details of the conventional stereo- 
neuroticism, although all of them 
ething of the grossness of the er- 
iling opinion. The decision was 
to attempt an extensive sur- 
vey of specific stereotypes about neuroticism 
and then, by comparing the stereotype with the 
observed reactions of diagnosed patients, to 
delineate some of the discrepancies between 
opinion and fact. In making such a search for 
discrepancies, the broader the sampling of be- 


liefs and attitudes the better. The Minnesota 
Inventory [5], by 


Multiple Personality 
reason of its systematic coverage of many areas 
of self definition and personal values, 1S eX~ 
ceptionally well suited to the task at hand, and 
was therefore selected as the research instru- 


ment. 


types about 
revealed som 
rors of preva! 
made, accordingly, 


Method of Analysis 
Seven samples of subjects were obtained in 
order to conduct the analysis. Four of these 
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Table 1 


Sample Items Revealing Erroneous Conceptions about Neuroticism 


ine ” 
Percentage saying “True’ 


Patients 
Dissemblers ley 
I Profes- Langley Oakland en 
Be sional Male Female Porter VA e a females 
rkers students students males males 2351) 
Fi WAN (N= 50) (N=50) (N=39) (N= 46) a) es T 
7 2 
16. I am sure I get 64 82 90 8 
a raw deal from life, š i 2 0 
35. If people had not had 36 68 86 
it in for me I would 
have been much more 
successful, 60 59 
88. I usually feel that 36 28 10 79 74 
life is worth while. . 26 2 22 
212. My People treat me 45 76 76 15 
more like a child than 
a grown-up, 67 
257. I usually expect to 27 36 10 72 76 88 
succeed in things I do, 2 
15 t 
459. I have one or more bad 73 80 88 8 13 
habits which are so 


ter 
Patients from the Langley Por 
Psychiatric Clinic, 


in fighting against them. 
samples consisted of Patients Psychiatrically 1. Fifty-one 
diagnosed as “ hi ic,” i 


items accordingly, Th 
ed as follows: 
. Males 
A. Patients 
E Thirty-nine 
of Califo 
Clinic,2 
2. Forty-six 


Patients fro; 


m the University 
rnia Langley 


Porter Psychiatric 


patients from 
Mental Hygiene Clinic. 


3. Forty patients from a U.S. Army station 
lospital,4 


. Dissimulators 
1. Fifty Students fro; 


the Oakland VA 


m a University of Cali- 
for aia, Berkeley, class in abnormal psy- 
chology,5 

2. Eleven professional Workers from the Army 
hospital. 
IL. Females 
A. Patients, 


*These records were 


very kindly furnished by Dr, 
R. E arris, 


s Dissimulators , mal 
1. Fifty students from the class in abnor! 
Psychology, . the 
For each of the items in the a os 
Proportion in each of the above simple a 
ing “True” was calculated, and then j je re 
ternal comparisons (I. A, 1 and I. e 1) 
Bair TA, 3 ys, I.B.2; and II.A. 1 vs. Il. a 
were made. All items yielding ages je 
statistically significant differences in eac! oul 
Parison were selected, These items, then, = 4 
be said to embody the fallacious stereoty ae 
‘he experimental samples. The entire sta pe 
cal table is too long to be given here, but Ate 
selected items are listed in Table 1 to in ed. 
the impressive magnitude of error hy gala 
ote, for example, item number 35: “If eee 
had not had it in for me I would have E 
much mw, 2 successful.” In the stereotype a aie 
SA complete version of this table, giving al ie 
criminating items and the proportion of each sarn 
answering “True” has been filed with the Ame: 3631 
ocumentatior Institute, Order Document No Ds 
from ADI Auxiliary Publications Project, ings 
duplication Service, Library of Congress, Was mie 
Ken remitting in advance $1.00 for mi 


le 
film or $1.00 for photocopies, Make checks payab 


to Chief, Photoduplication Service, Library of Con- 
gress, 


| 
| 


| 
| 
| 


ee Patiente will say, this sentiment features 
Taten and yet, in the actual responses of 
OF this 7 it is almost nonexistent. In the light 
Ea auler finding what is one to make 
“fac? ory which attempts to account for the 

that psychoneurotic patients tend to 


ar . 
rbor such feelings, and to express them on in- 
quiry? 


Al . . -po . 

me Pe a KE items were identified which 

se criterion of significance.’ These items, 
e direction of response given more fre- 


ue ; 
q atly by the simulators, are listed below: 
10. There 


Si . 
Gite aa To f beia Timpiinamy timat much 


(True) 14. I have diarrh 

mont iarrhea once a 

deal ae it (True) 16. I am sure I get a raw 

T like to eps (True) 19. When I take a new job, 

to, (True) set off on who should be gotten next 

and vomiti 3. I am troubled by attacks of nausea 
stand me on (True) 24. No one seems to under- 
ach Bent Prue) 29. I am bothered by acid stom- 

Mares Gia Hse a week. (True) 31. I have night- 

hot had fe few nights. (True) 35. If people had 

Successful BS for me I would have been much more 

Work J ing (True) 42, My family does not like the 
Gian 4 ve chosen (or the work I intend to choose 
44. be work). (True) 

Over, in the time my lead seems to hurt all 
enly hot all 7. Once a week or oftener I feel sud- 
E My soul Mery, without apparent cause. (True) 
minister sometimes leaves my body. (True) 53. 
is hand Sogi cure disease by praying and putting 
eel pain in Hon head. (True) 68. 1 hardly ever 
Mi dinnotane he back of the neck. (False) 73. I am 

and willin person. (True) 83. Any man who is able 

ceeding, (Fal, work hard has a good chance of suc- 

While. (Fals se) 88. I usually feel that life is worth 

alse) 93, I think most people would lie to 


Bet ah 
With ad (True) 96. I have very few quarrels 
97. At ers of my family, (False) 
thin times I have a strong urge to do some- 
gh g urg 


wet Fo shocking. (True) 104, I don’t seem 
kalot appens to me. (True) 125. I have & 
that my ho stomach trouble. (True) 137. I believe 
People I S life is as pleasant as that of most 
Matters, (Tru (False) 179. l am worried about sex 

an most Ba 206. I am very religious (more 
ent kinds of ple). (True) 207. I enjoy many differ- 

in of play and recreation. (False) 210. Ev- 

e ` > 

ferentiation ET items revealing the greatest dif- 
Copyright ow: are included (by permission of the 
Writers Caine as a “dissimulation scale” in the 
tight 1951 Thicke Psychological Inventory, copy- 
Variables h nis inventory is one designed to -ssess 
televanes -2Ving broad sdcial and interactional 
Medical, + rather ‘than those pertaining to special 
for y,.. Psychiatric, or vocational categories. Scales 


to care 
Breat d 


var 
se aad ee such as social responsibility, domin- 
emic mot ership, intellectual efficiency, and aca- 


ivation are included, (See, for exatnple 4] 
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erything tastes the same. (True) 211. I can sleep 
during the day but not at night. (True) 212. My 
people treat me more like a child than a grown-up. 
(True) 

216. There is very little love and companionship 
in my family as compared to other homes. (True) 
226. Some of my family have habits that bother and 
annoy me very much, (True) 241, I dream fre- 
quently about things that are best kept to myself. 
(True) 246. My neck spots with red often. (True) 
247. I have reason for feeling jealous of one or more 
members of my family. (True) 257. I usually expect 
to succeed in things I do. (False) 297. I wish I were 
not bothered by thoughts about sex. (True) 303. I 
am so touchy on some subjects that I can’t talk about 
them. (True) 306. I get all the sympathy I should. 
(False) 320. Many of my dreams are about sex mat- 
ters. (True) 

325. The things that some of my family have 
done have frightened me, (True) 328. I find it hard 
to keep my mind on a task or job. (True) 341, At 
times I hear so well it bothers me. (True) 344. Of- 
ten I cross the street in order not to meet someone I 
see. (True) 352. I have been afraid of things or 
people that I knew could not hurt me. (True) 360. 
Almost every day something happens to frighten 
me. (True) 375. When I am feeling very happy 
and active, someone who is blue or low will spoil it 
all, (True) 388. I am afraid to be alone in the dark. 
(True) 405. I have no trouble swallowing. (False)» 
419. I played hooky from school quite often as Wy 
youngster. (True) 

422, I have felt embarrassed over the type of work 
that one or more members of my family have done. 
(True) 433. I used to have imaginary companions. 
(True) 438. There are certain people whom I dis- 
like so much that I am inwardly pleased when they 
are catching it for something they have done. (True) 
443. I am apt to pass up something I want to do be- 
cause others feel that I am not going about it in the 
right way. (True) 453. When I was a child I did- 
n’t care to be a member of a crowd or gang. (True) 
458. ‘The man who had most to do with me when I 
was a child (such as my father, stepfather, etc.) 
was very strict with me. (True) 459. I have one or 
more bad habits which are so strong that it is no 
use in fighting against them. (True) 466. Except by 
a doctor’s orders I never take drugs or sleeping 
powders. (False) 471. In school my marks in de- 
portment were quite regularly bad. (True) 475, 
When I am cornered I tell that portion of the truth 
which is not likely to hurt me. (True) z 

476. I am a special agent of God. (True) 480. I 
am often afraid of the dark. (True) 481. I can re- 
member “playing sick” to get out of something. 
(True) 485. When a man is with a woman he is 


- usually thinking about things related to her sex. 


(True) 518. I have often felt guilty because I have 
p-etended to feel more sorry about something than 
I really was. (True) 519. There is soraething 


wrong with my sex organs. (Toue) 524. I am not 
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the time. (True) 

541. My skin seems to be unusually sensitive to 
touch. (True) 543, Several times a week I feel as 
if something dreadful is about to happen. (True) 
545. Sometimes I have the same dream over and 
over. (True) 565, I feel like jumping off when I 
am on a high place, (True) 
The similarity of these items to a conven- 
tional neuroticism questionnaire 
Most observers, professionally trained or not, 
would Probably identify the items at once as 
Pertaining to maladjustment, Nevertheless, the 
inference seems justified that they do not per- 
tain to neuroticism and maladjustment, but 
rather to the Prevailing Stereotypes about neu- 
Toticism,® 

For each of the specific instances listed, neu- 
otic patients answer in Precisely the Opposite 
direction from what is Predicted for them, 
They do not, in other words, respond “True” 


to questionnaire items like “No one seems to 
understand me,” “T don’t Seem to care what 


ʻI have one or more bad 
abits rong that it is no use in 
fighting against them,” and they do respond 
True” to items like “I get al] the sympathy 

y "I usually expect to succeed in 

” Even such a short listing 


is obvious. 


of 74 items, the 
Jective clustering, The Broupings which were 
derived are as follows: f 


1. Numerous 


Physical complaints and dysfune- 
tions, r 
2 Feelings of victimization, injustice, and mis- 
understanding; lack of hope for and faith in the 
future, 


also tend to substantiate the view- 
point that structured personality tests may contain 
subtle and dynamic f 
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j ness, 
3. Exaggerated irritability, petulance, tense 
fear, and anxiety. i 
4. Lack of independence and self-sufficiency; 
ability to face issues squarely. , and 
5. Dissatisfaction with family background 
childhood, 


6. Sexual conflicts and preoccupations. 


i ive religiosity- 
7. Bizarre, eccentric ideas; excessive religi 


These clusters, then, summarize to some a | 
tent the kinds of emphases which are e a 
much weight in the typical stereotypes oa 
the expressed beliefs and attitudes of m 
justed persons. 


Cross-Validating Samples 


; ieved 
The separate item discriminations aa 
in the analyses were sufficiently striking eee 
gest trying them as a scale for dissimu maples 
For this purpose a number of new sa a a 
were obtained. T'he results are indicate onl 
Table 2. Of the 13 samples in Table 2, is 
one, the 11 Army dissemblers, was used ye. 
item analyses just reported. All of the ma 
samples include cross-validating cases only 'hat 
that the results are probably similar to M 
would be anticipated in most subsequen 
plications of these items as a scale. ai 
The analysis of variance over 13 oe 
samples yielded an F ratio of 374. iae 
nificant well beyond the .01 probability p is 
The clinical samples and the student apt 
both average near the lower end of the s hers 
with the dissimulators all scoring much hig! 4 
If the eight clinical samples are pooled a d 
composite (N = 915), a mean of 15.94 p 
standard deviation of 9,99 are obtained. N 
the student samples the combined figures r% 
= 507) are 15.88 and 7.90. The diferen, 
tween the means is .06, and the CR, 0. oe 
This is an importaat finding, for it na 
that patients diagnosed as psychoneurotic ‘a 
tually achieve mean scores on this scale gone 
identical with those attained by a large Bn 
hospitalized sample. Patients not a ar 
respond to the questions in the manner noe 
ed by usual conceptions, but are actually ral 
distinguishable from normals in reacting to t : 
Set of 74 statements, Furthermore, both pr 
tients and control samples score considerably be 
low the mean achieved by subjects asked tO 
simulate a psychoneurotic reaction. 


The distributions of Scores for the three con 


a 
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Table 2 
Means and Standard Deviations on the 74+Item Dissimulation 
Scale for the Samples Indicated 


ample 


pees anal Ne LL 


A. Dissemblers 
T E rofesaitnl workers 
i aa in abnormal psychology 
B. s in personality in society and culture 


Clinical cases 


Í S heer 
Army psychiatric patients 


2. Ft. Snelli 
é Ft Snelling VA Hospital ° 
me J lospita males 
A akland VA Hospital males** 
5. Langley 
A ae Porter Psychiatric Clinic malest 
4 ag cy Porter Psychiatric Clinic females} 
a versity of Minnesota Psychiatric 
mamon males}: 

niversity of Minnesota P; iatri 

ee ey E i 
CN Division females} Sename 
" L aclinical samples 

+ High school freshmen 


8. 


Soli 
= pe samples—dissemblers, clinical cases, 
he pate Presented in Table 3. 
Tresented inn Ton the threefold breakdown 
significare’ it Table 3 was 2,141.04, a clearly 
value. The screening efficiency of 


Table 3 


Proporti 
Portion of Cases Falling in the Scoring 


| Categories Indicated 
a 


Scor, m Clinical 
Sa sabler cases Students 
7 TEN =354) (N=915) (N= 507) 
65-69 oe 
60-64 nt 
Fee 169 
-5 . 
45-49 14.7 0.4 
40-44 11.0 0.8 0.2 
35-39 7.3 1.8 0.6 
30-34 4.2 2.6 91.2 
25-29 3.7 5.3 45 
20-24 2.0 7.2 As 
15-19 0.6 12.5 14.8 
10-44 0.3 17.5 23.2 
o 5g 0.3 21.5 24.6 
0-4 19.8 19.3 
“i 10.1 3.9 
3D 54.13 15.94 15.88 
11.69 -9.99 7.90 


ei i ee Se y E -T y 
S 
F San F rs 
an Francisco VA Mental Hygiene Clinic males** 62 
r 
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N M SD 
11 46.82 11.21 
302 53.96 11.52 
4H 57.34 11.90 
250 18.87 10.94 
99 16.91 11.45 
103 13.40 10.20 
17.45 9.33 

100 15.05 9.21 
100 16.25 9.58 
101 12.31 7.02 
100 13.59 6.86 
223 16.89 8.32 


284 


e 
‘The: 
7 SO re ` 
These Teeords wore very kindly furnished by Dr. William Hales. 
i These records were very kindly furnished by Dr. G. S. Welsh. 
These records Wore Very kindly furnished by Dr. R. E. Harris. 
were very kindly furnished by Dr. S. R. Hathaway. 


the Ds scale for these cross-validation samples 
(all were cross-validating cases except for th 
11 Army dissimulators) can be exampled by a 
cutting score of 35. Ninety-three per cent of 
the dissemblers scored at or above this point, 
whereas only 6 per cent of the clinical cases 
and 2 per cent of the students did so. 

The results obtained in treating the differ- 
entiating items as a scale further underscore 
the erroneousness of the particular aspects of 
the clinical stereotypes of neuroticism they 
embody. The opinions and sentiments contained 
in the items are not expressed, or more ac- 


. curately, assented to, with any more frequency 


by diagnosed psychoneurotic patients than by 
control samples, and, furthermore, are agreed 
with much Zess frequently than the convention- 
al conceptions of neuroticism would presage. 


Summary 


An investigation of typical ‘conceptions of 
neuroticism was conducted by having subjects 
take the role of a psychoneurotic patient in re- 
sponding to a personality inventory. Signifi- 
cant discrepancies between what diagnosed pa- 
tients did, in fact, report on this inventory and 
the stereotypes given by the simulators were 
discovered. 
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The argument was advanced that errors of 
the magnitude observed suggested a consider- 
able degree of misinformation in the prevailing 
Conceptions about neuroticism, 

Finally, it was Possible, by consolidating the 
items individually tapping these misconcep- 
tions, to develop a measuring instrument yield- 
ing similar scores for both patient and control 
samples, and differentiating each from sam- 
ples based on dissembled records, 


Received November 16, 1953. 
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5: Factors Descriptive of Chronic Schizophrenics 
elected for the Operation of Prefrontal Lobotomy 


Maurice Lorr, Richard L. Jenkins, and James Q. Holsopple 


Veterans Administration, Washington, D. C. 


„This study was undertaken in the hope of 


* contributi 
ibuting to a simpler and conceptually 


abe Rtaitory differentiation of the major 

Sre dee nic processes. To this end a set of 

Phrenics e of a group of chronic schizo- 

oborom. G me for the operation of prefrontal 

jected y, and their matched controls were sub- 
to a multiple-factor analysis. 


Procedure 


et ae consisted of clinical judgments re- 
ule of 81 ' Northport Record [4,7], a sched- 
the Charach rief rating scales for describing 
Psychotic eristic behavior and symptoms of 
Y psycl Patients, The ratings were made 
scl 1s erg and | psychologists on 153 
ministration | patients at six Veterans Ad- 
ing in a seul hospitals which are participat- 
oF chan a rd to define the nature and extent 
tion an ot occur as a result of the opera- 
Were hes rontal lohotomy [3]. All ratings 
ater tae prior to operation on patients 
serye as —— or on patients selected to 
Mentally ee Since no patient had been 
resent a or less than 4 years, the data rep- 
ecome ps of patients whose psychoses had 

Th ronic, 
wea on = included’ in the study were 
ospitalized actor analysis of ratings of 423 
ables includ “ig ae on 55 of the scale vari- 
“ach score ed in the Northport Record [5]. 
received b x nsisted of the sum of the ratings 
efining N f he patient on a group of scales best 
Projection aE For example, the paranoid 
Tatings on i C consisted of tlie sum o- the 
ence, delusi S descriptive of ideas of refer- 
fluence ns o persecution, delusions of in- 
relativel f requency of assaults. There were 
y tew scales common to two or more 


factors. Factor Æ, depressed retarded versus 
manic excited, and factor E, melancholy agita- 
tion, had 4 scales in common. A few of the 
factors had two scales in common. Of the 55 
possible relations between factors there is no 
overlap in 34. 

The 11 factors scored have been named as 
follows: 

A. Retarded depression versus manic ex- 

citement 

B. Compliance versus resistiveness 

G. Paranoid projection 

D. Activity level 

E. Melancholy agitation 

F. Perceptual distortion 

G. Motor disturbances 

H. Submissiveness versus belligerence 

I. Aggressive social interest versus social 
withdrawal 

J. Self-depreciation versus grandiose ex- 
pansiveness 

K. Conceptual disorganization 

The Pearson correlations computed between 
the 11 factor scores are presented in Table 1. 
The correlational matrix was subjected to a 
centroid analysis with centroid estimates of the 
communalities in the diagonals, and 3 factors 
were extracted. The median absolute third fac- 
tor residual was .06 as compared to the stand- 
ard error of .08 of a zero correlation on a 
population of this size. The orthogonal factors 
and the rotated oblique factors are presented 
in Table 2. The cosines between the reference 
vectors are as follows: Alpha versus Beta, 075 
Alpha versus Gamma, 51; Beta versus Gam- 
ma, .05. The transformation matrix is shown 


in Table 3. 


% 
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Table 1 
Tntercorrelations of Raw Scores on 11 Factors 
of 153 Schizophrenic Patients 


FG HT 


2B O D E 
=13 


J 
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The Findings 
The first factor, Alpha, is defined by with- 
drawal (I), Conceptual disorganization (K), 


Maurice Lorr, R. L. Jenkins, 


and J. Q. Holsopple 


ligerence), factor I (withdrawal), factor 2 
(compliance versus resistiveness), and factor : 
(self-depreciatory versus grandiosity). At on 
end Gamma is characterized by overt hostility, 
irritability, assaultiveness, obscenity and a 
fanity, neglect of personal appearance, 18014 
tion from others, resistiveness, and destructive- 
ness. Ideation is marked by ideas of grandeur 
and boastful conceit. The opposite end, "4 
Gamma is characterized by a meek eaten 
ness, compliance to routine, and self-deprect 
tory tendencies, 


E 


The belligerent, resistive, assaultive wer 
of Gamma is often associated with an a 
agitation. This would account for the subi 
tial negative relation between Alpha a 


Table 2 
Second-Order Centroid Matrix F and Oblique Matrix V se 
TF v 
Factors I iat m hej a B 7 
Depression® a a 61 18 48 55 4 “6 
Resistance 3 B 70 07 27 57 49 36 a 
Paranoid distortion Cc 34 25 —24 23 —02 t K 
Overactivity D 09 30 —07 10 —17 20 : 
*Apathys E nas 50 16 48 60 27 a 
ereeptual distortion F 60 26 —55 7 05 85 A 
otor disturbances G 49 —36 09 ; 0 18 oa 
need H 44 63 62 98 04 i s 
ithdrawa T 
Grandiosity ; i E i = | E E 
onceptual disorganization K 78 —30 —29 bs E 65 z 
*AandE and their descriptions have been reversed in matrix V, 


The second-order factor, Ga 
negatively related to Al 
defined by factor A 


Gamma although the two also have in com 
mon withdrawal and resistive tendencies. is 
is the type of patient high on Gamma who 
frequently a candidate for lobotomy. 


Table 3 
Transformation Matrix 
A B (o 
I 66 ` 72 63 
I —.69 .32 18 
UI 29 —.62 15 


The sczond-order factor, Beta, has its high- 
€st correlations from Perceptual distortion (F » 
conceptual disorganization (K), and parano! 
Projection (C ). A patient scoring high on 


this factor js characterized by auditory and, , 


Visual hallucinations, 


ideas of reference, ant 
elusions 


of persecution and influence. He 18 
likely to be irrelevant or incoherent in his 
Speech, and disoriented as to who he is or who 


It y 


j 


f 


Factors Descriptive of Chronic Schizophrenics 


others are around him. 
tor nonhrenic patients considered for lobo- 
i me in the foregoing terms, be said to 
4 ree distinguishable modes of reaction. 
eee (Alpha), they distort in per- 
ae bs thought the world they encounter 
z Maa (Beta), and /or they fight (Gam- 
ate ihe withdrawal factor Alpha is 
ine a So the disorganization of think- 
ikely = , = is not obvious, the patient is 
within r Ti as showing catatonic 
Aan n f disorganization (Beta) is pro- 
Po a oe Patient will tend to be diagnosed 
he ee If the progress of the disor- 
ion n is slowed by the false solution of 
a on, the patient will be cat- 
Soe ey Paranoid schizophrenic. If an as- 
eels’ igerence (Gamma) is marked and 
ated with an agitation (negative Alpha) 


the pat; : 
` Patient will be regarded as a good candidate 
F lobotomy. 


Discussion 


sgh ime second-order factors identified 
ed by Tee, be compared’ with those identi- 
O'Connor Ts) Uh and by Lorr, Jenkins, and 
pled differed c ince the patient groups sam- 
the scales u gonsiderabiy in these studies and 
only a enl were different, we can expect 
identified Men Correspondence in the factors 
ow much ot it is of interest to see 
Common, ese second-order factors have in 
5 

Mn lied data collected by Father Te 
iagnosed as s on 367 hospitalized patients 
ed nine eg a psychotics. He identi- 
Second-order oe factors and four in the 
Jections of hi omain. Table 4 presents the pro- 
is first-order factors on the second 


— Table 4 
San’s Second-Order Rotated Oblique Matrix 


Fi S -order 

Ñ Itst-order factors oe ong gr 
®Perprojection 3 5 
Tessie 2 Ex- a En z 

“Manic hyperexcttahstt -06 — 

Catatonia scaly @ S6 A3 -03 00 
chi ta ee ) -08 -03 -01 71 
aa dissociation Æ -01 68 01 03 

auc hysteria A = 
YPerirritability A = 20 35 
etioration H 3 =l -37 33 
ĉurasthenia 1 z= a be 3 
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order. In the study by Lorr eż al. [5], 55 rat- 
ings descriptive of 423 hospitalized psychotic 
patients were factored. The 11 first-order 
factors were analyzed and three second-order 
factors were identified (Table 5). 

Degan’s second-order factor Z, interpreted 
as catatonic schizophrenia, is most similar to 
factor Alpha. Factor Z, in terms of the origi- 
nal variables, is defined by mutism, refusal of 
food, stereotypism of attitude, negativism, 
giggling, and absence of an agitated depression, 
To a lesser degree, it is characterized by dis- 
orientation for time and space, irritability, 
tantrums, and loss of finer sensibilities. Only 
the irritability elements of factor Z are lacking 
in our Alpha. It should be noted that Alpha 
was identified in a group of patients diagnosed 
as schizophrenic and sufficiently chronic to be 
considered for lobotomy, while factor Z was 
derived from a mixed psychotic population. 
Furthermore, in the population from which 
Alpha was drawn, assaultiveness, hostility, and 
irritability were sufficiently common as to de- 
fine factor Gamma (belligerence). It is for 
these reasons that irritability has its projec-° 
tions on Gamma rather than Alpha. 


Table 5 
Second-Order Oblique Factor Matrix Based on 
Intercorrelations between Primaries 
(Lorr, Jenkins, O’Connor [5]) 


Factors AA BB CC 
Depression A 47 25 34 
Resistiveness B 54 06 22 
Paranoid distortion C -08 39 -03 
Overactivity D -21 -42 0i 
Apathy E -03 00 54 
Perceptual distortion F 09 34 02 
Motor disturbances G 56 01 00 
Belligerence H 58 21 03 
Withdrawal I 45 04 68 
Grandiose expansiveness J -20°-10 26 
Conceptual disorganization K -29 03 13 


Factor 44 (Table 5) is characterized by 
resistiveness, frequent assaults, manneristic 
movements and postures, disorientation for 
time, place, self, and people, a complete lack of 
interest, and muteness. Alpha has in common 
with 44 manneristic movements and postures, 
disorientation, and withdrawal of interest, but 
it lacks the assaultiveness of 44. In addition, 
Alpha is characterized by a conceptual disor- 
ganization missing in 44. * 
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Beta has considerable resemblance to De- 
gan’s factor X, which is defined principally by 
stereotypism of words and of actions, talking 
to voices, appearing “shut-in,” disorientation 
for space and time, hallucination, and bizarre 
delusions. Only the resistiveness and grandio- 
sity of Beta are absent. 

Beta is probably the same as factor BB in 
Table 5. Factor BB is defined by delusions of 
influence, ideas of reference, ideas of persecu- 
tion, auditory and visual hallucinations, and 
slowed activity. It lacks only the thinking dis- 
organization of Beta. 

Since the present study was confined to 
severe chronic schizophrenics, it is not surpris- 
ing that primarily affective factors present in 
the other two studies are missing. In Degan’s 
study, we have a factor of manic excitement 
(IP) and a bipolar factor of paranoid versus de- 
Pressive psychosis (Y), ie, of projections 
versus introjection. Factor CC, on the other 


hand, is based on an analysis of a population 
probably having fe 


pressive psychosis 


‘phrenic than affecti 


© not appear in the present 
ic schizophrenics. 

actor Gamma is unique to 
No doubt it is due to the 
e of patients considered for 
Table 6 


een Second-Order Factors 
Three Factor Analyses 


the present study. 
selection of a sampl 


Similarities betw 
Identified in 


Hypothesi-ed process Degan’s 
analysis 


isorganization and mee 1 
distortion of thinking ¥ BB Beta 
«+ Manic excitement wW CC(?) Not found 
(schizo- 
Projection versus ao 
introjection z p 2 


Belligerence Not found Not found Gamma 


Maurice Lorr, R. L. Jenkins, and J. Q. Holsopple 


ely 
lobotomy, many of whom were ie a | 
tense and assaultive. Resemblances between 
factors are summarized in Table 6. 


Summary 


A factorial analysis was made of the ber 
correlations between 11 relatively indepen hel 
scores descriptive of the behavior and ne 
pathology of 153 chronically ill schizop a 
patients selected for prefrontal lobotomy ne 
their matched controls. Three common fac a 
were extracted and rotated to simple eini A 
Alpha is interpreted as a factor of apa my 
withdrawal with motor disturbances. Be me 
a factor of perceptual and thinking ditor at | 
which may represent a phase of schizop ore, 
disorganization. Gamma describes a ae ha 
reaction. The negative relation between a 
and Gamma suggests a third-order bipolar ra | 
ameter of apathetic withdrawal versus ag! 
ed belligerence, 

The first two factors resemble those found 
in Degan’s analysis of Father Moores s 
and those isolated in the Lorr, Jenkins, 4 
O'Connor study. 
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Group Therapy Techniques with Hospitalized 
Chronic Schizophrenic Patients 


Joseph M. Sacks and Stanley Berger 
Franklin D. Roosevelt VA Hospital, Montrose, N.Y. 2 


; Pee aint years, the predominant ap- 
schizoph o group treatment of hospitalized 
or da “te patients called for mass activities 
cently the ectures [4, 5, 7, 8, 11]. More re- 
of oot ine has been an increased application 
group psy see principles and techniques in 
a ar peta Le 
aby have nt approaches to group psychother- 
of feelin n common the expression and release 
al oor mutual understanding and emotion- 
eon GN of the individual’s high- 
member en needs, an opportunity for each 
thinking = a8 group to test his behavior, 
impact u nd feeling against the reality of his 
Problems wi others, a shating of common 
Working with others, and the cooperative 
With deus of solutions to these problems 
ance, Theo self-understanding and accept- 
group tre authors of this paper believe that the 
Volves all a den of psychiatric patients 10- 
ition whi i nese elements and something in ad- 
erstanding is of crucial importance: the un- 
S a and exploration of distortions 1n 
eir inter ons and behavior of the patients in 
Presents a gai relationships. This paper 
Ployed and Psem pioN of the techniques em- 
apply a obtained in an attempt te 
reatment 3 ynamic principles to the group 

| he et chronic schizophrenics. 
Plied for niques to be described have been ap- 

the past year to four groups of 2 


Patient 

S . . 

| 1 Sub: on the Continued Treatment Service 
Submit í y 
ical Oter le the approval of the @iief Med- 

| o E Eee Administration, who assumes 
Which are ility for the opinions expressed here, 
te those of the authors. 


2The 
Pation ae gratefully acknowledge the partici- 
T Shiatrists: TE ee of the following ward psy- 
‘aul o Jordani, Maurice Pachter, and 
anna Husse e also wish to thank Edwin Barker, 
and Meter a Warren Fox, Nathaniel Wagner, 
Who Partici inger, clinical psychologist trainees, 
pated in various phases of this project. 


of the Franklin D. Roosevelt VA Hospital. 
The groups were conducted by cotherapists, in- 
cluding a psychiatrist, a staff psychologist, and 
a clinical psychologist trainee. The groups met 
twice weekly for periods of an hour and a half. 

A control group was derived from the hos- 
pital admissions records of patients admitted 
to the Continued Treatment Service on the 
same day as the patients of the therapy group. 
No significant differences were found between 
the two groups with respect to age, socioeconom- 
ic level, education, or intelligence. 


Theoretical Considerations 


In our approach to group therapy, we in- 
corporated some of the more basic theoretical) 
formulations that have been fruitful in treat- 
ing less severely disturbed patients. In general, 
the concepts discussed above were integrated 
into a philosophy of therapy which we felt 
would be of value in any group psychotherapy. 
However, the focusing of treatment upon 
chronic, regressed schizophrenic patients neces- 
sitated a broadening and elaboration of some 
of the more succinctly presented theoretical con- 
cepts, as well as additional formulations pecul- 
jar to our patient group. 

We have been guided by the following as- 
sumptions: 

1. One of the primary charactiristics of 
schizophrenic patients, according to certain 
workers [9, 10, 12], is their acute sense of dep- 
rivation ; that is, they react as though they have 
experienced the trauma of never having had, 
or of losing, a mother-figure who normally 
would have satisfied their physical needs (often 
symbolized by food), as well as their emotion- 
‘al needs, by providing comfort and consistent 
love, protection, and security. In reaction to 
these basic deprivations with their inherent 
threat to life itself, the infant, has been forced 
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to draw upon modes of adjustment and per- 
ception which are highly distorted and which, 
persisting to adulthood, prevent the develop- 
ment of more healthy and satisfying psycholo- 
gical mechanisms of defense. 

2. The reliance upon inappropriate and dis- 
torted defenses is experienced by the patient as 
highly inadequate, fraught with potential dan- 
ger and anguish, and in constant threat of col- 
lapse. Federn [2] stresses the point that the 
schizophrenic patient is constantly defending 
himself against becoming aware of the original 
fear of isolation and deprivation (death), and 
must continually apply whatever defenses he 
can to manage some sort of psychic equilibrium 
or reduction of tension. However, the patient 
is aware (at some level of consciousness) that 
these defenses are not effective. 

3. Many techniques applicable to neurotic 
groups, 
phrenics or schizophre 


apeutic benefit, 
4. The most immedi 


interpersonal 
schizophrenic 
ficult to treat, Techni 


avenues tu the pers 
Pist a valuable, though 


; delicate, hold upon 
the inner desperate hope for health which, it is 
assumed, almost every patient has. + 


1 We believe tnat the techniques described be- 
low are valuable in a chronic-schizophrenic 


group setting, and that their application pro- 
vides a successful i 


tients. In the followi 
merate briefly the i 
theoretical rational 


Joseph M. Sacks and Stanley Berger 


nents of the therapeutic situation. When ie 
sible, specific examples drawn from tape ia 
corded transcriptions of group sessions are 
cluded. 


Technique 


The therapy. Making contact with pel, 
tients requires a very active role on the pa mp- 
the therapist, for contact cannot be p, 
lished by a passive-permissive attitude no ad 
ter how kindly or well intentioned. enea j A 
example, begets more silence. We have s hour 
therapy group sitting together for an E 
without uttering a single word. These pati an 
often withdrawn into their own autistic 14 ie 
tasies and reveries, cannot be brought eats 
rect contact with each other without eo 
stimulation, most frequently by a direct dis rip 
sion of the silence. The following the thers 
tion demonstrates the active role of tete ; 
pist in building up a positive relationship añ 
patient who has exhibited marked hostility 4 
assaultiveness : 


sate give 

P. You make it sound as if my father didn’t 8! 
a damn about me, 

T. That’s how you feel? 1 get 

P. My grandfather was someone age fellow 
long with much better. He was the kind 9; He's 4 
who gave advice and respected my opinions. 
man who would shake your hand. 

T. I will shake your hand. 

P. You would? 

T. Yes. 


P. You mean as a sign of respect? 
T. Yes, m 


P. Well then, here, to p?” 

Patient extends hand; therapist walks OVEN tears 
tient and shakes his hand. Patient bursts into a 

Another fruitful technique for active ra È 
lation is to facilitate the patient’s andere ee 
ing of the deprivations which he exp Ee 
carly in life and the manifestations of nic 
needs in the present situation. Material W ti 
has meaning on other levels of adjuster 
most frequently dealt with on this early le aa 
assuming that this is most fruitful and a d 
ingful for these patients [9]. If less direct eek 
ods are employed, patients respond with eves" jn 
confused, autistic material, often engaging ar 
long meaningless monologues. When the eh 
tients are able to resolve some of the difficult t 
in their earliest relationships, increasingly ee 
er use is made of material related to later P? 


ar 


eS  Á— 
E A 
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iods of adjustment. However, the early dep- 
Tivations have, been so severe that there is a 
constant return to problems arising out of this 
peed. ‘The handling of these feelings of in- 
ape deprivation, in which the underlying 
ear of death is revealed, is demonstrated by 
the following example: 

P. I would be all right if it weren’t for the pain. 

T. What pain? 
et ee 

n Wion does this happen? 

T. a from the whisper. 

pm at whisper? 

+ They say those nasty things. I have to fight 


them. P, { 7 5 
mea be all right if I didn’t have to eat that 


a What medicine? 
ods a stuff they put in my food. It makes my 
we I get these awful pains. 
+ Why do you eat the medicine? 
a pinky to. It keeps me alive. The doctors made 
pe er give it to me when I was a child so I 
n’t end up in a hospital. 
= oF in a hospital now. 
ni eah, but I’m not dead. 
., D You say you were afraid that you would die 


i $ 
‘0 A LX 
nae u didn’t eat the bitter medicine your mother 
ve you? 


» Youre not kidding, Doc! 
the tee validate our understanding of 
for > ae s acute sense of oral deprivation in 
above, a ri theoretical considerations discussed 
t eo ean As ol willingness to try to satisfy 
chocolate) ring “food (chewing gum and 
ly the dire to 90 group sessions. It is not mere- 
inescthaes s physical Satisfaction of oral crav- 
ly, the pro involved here, but more significant- 
ental feu cess of receiving food from the par- 
ani oc = as represented by the therapist, 
group. TI ing of it in the family setting of the 
ania a is he patients respond quite favorably, 
tients he Sacer that in-some cases the pa- 
or offer ie out buying candy for the therapist, 
one sessio im cigarettes during the session. At 
reals rae of brought in a bun from his 
ter of Senn placed it on the table in the cen- 
lam foe for all to share. 

tionship witl eo No a to construct some rela- 
sort to thin the patients, the therapist may-re- 
ion (no ti attempts to dress in a similar fash- 
| el le, sleeves rolled up), sit in a sim- 
and ee, (slouched, or at times stiffly), 
atter, th in a similar manner. In terms of the 
» the use of common language is certainly 


more meaningful to these patients, and at the 
same time is, in a sense, granting them permis- 
sion to speak freely and honestly. The follow- 
ing example points out the importance of com- 
munication with the patient in his own langu- 
age as a means of building up positive relation- 
ship: 

P. I don’t know how many personalities I have. 

T. Why don’t you know? 

P. Because I always thought a person could talk 
to another person in an understandable way. That 


is personality. 
T. Can you talk to a person in an understandable 


way? 

P. I mean if he is angry, or if he is sad. Person- 
ality to me seems like I feel when I have medicine; 
the way you talk to a person, the way you answer. 

T. It must have something to do with the way 
you talk to me. How do you talk to me? 

P. I mean you talk not only because your words 
are well spoken, or the sound of your voice, but you 
can understand what I mean, and I can under- 
stand what you mean. 

T. We understand each other. 

P. Sort of a love affair. That’s what I think per- 
sonality is. 

T. You love me because 

P. That’s right. € 

The therapist. A difficult task for the thera’ 
pist is to permit a relaxed and receptive at- 
mosphere within himself so that he can be more 
sensitive to the highly symbolic associations of 
the patients, and can rely upon his own clini- 
cally intuitive responses to aid in communica- 
ting with them. To maintain this sensitivity to 
communication requires a healthy personality 
for the therapist, who can, by accepting his 
own impulses and needs in a mature manner, 
be more accepting of the patient’s desires and 
impulses. It has been often observed that schizo- 
phrenic patients are very perceptive, and they 
will be quick to observe in the therapist anxiety 
and fear, and especially rejection. 


The therapist maintains himself as the cen- 
tral figure in the group about which therapy 
pivots. Though the patients may shift about, 
the therapist always sits in the Same seat, often. 
indicating the strength and valence of the re- 
lationships, the patient’s need for contact, and 
his desire for communication. 

The consistency of the therapist is further 
emphasized by his remaining with the group 
despite other hospital assignments or corumit- 
ments. If the group is transferred to another 


I understand you? 
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building, it is desirable for the therapist to be 
transferred likewise. Such maintenance „of 
group integrity provides a group-stabilizing 
force, as well as a means of helping the patients 


make these kinds of moves and new adjust- 
ments. 


negative ones. Hostility, rivalry, and competi- 
tion within the group must not be allowed to 
continue too long. When too much hostility is 
expressed by one patient to another it must be 
redirected (preferably to the therapist) and re- 
duced in strength so that the angry patient and 
the rest of the group are not overwhelmed by 
an overt display, Prolonged uncontrolled ex- 


otentially upset- 
ting to schizophrenic patients who are in con- 


off the entire group if the therapist fails to be 
the strong, controlling figure. The following 
i ging patient to pa- 

open and redirect- 

gine it toward the therapist; 


A. [For about fifteen minutes 

i t role tow; 
the group, 
his plans for th 


your sickness? 


C. [Has been squirming in his seat, 
left the room and returned, ] 

T. [to C] How 
few minutes? 


C. Like I'm going to explode. 

E Why is that? 

iG; Listening to A shoi 
trying to help B, h 
e knows, 


flushing, 


have you been feeling these last 


ot off his mouth, He isn’t 
e is just trying to show how much 


A. That's not true. We are 
other here, 
T.M 


when I did that, 


B. May I say something? Yes, 
but also I felt he 

me and I appreciate it, 
C. He wasn’t trying to help, 
to play the doctor, 
A. Maybe yowye got someth; 
ly was aware of it though. 


I did resent what 
Was trying to help 


He was just trying 


ing there, C, I certain- 
I guess you do resent 


; 


n 

i your ow! 

it, doctor, when someone points out y 

weaknesses to you. F je tale 

ether tal 

[After the session A and C go ens fashion 

ing with much animation, but in frie 

rather than in a hostile manner.] 
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; : ught 

The group. The patient’s illness wr a 
of in terms of “ego-sickness” [2]. listic ques’ 
tients request an answer to some to discus 
tion, or when it is felt beneficia ocess, the 
Some aspect of the schizophrenic Pean m 
explanation is centered about the ak an uo" 
ability to reconcile bodily impulses w disinte’ 
relenting superego, and the iene ity 
gration or fragmentation of the re it 8 
structure. When the therapist re i atient | 
beneficial to reply to a question wee how 
concerning his illness, the reply shou s quick 
est and straightforward. Such franknes EM 
ly earns the patient’s respect. Dealing vo 
patient’s illness openly and honestly is r 4 
ing, not threatening as illustrated et A 

P. So my father told me to come up patel ‘ 
couple of Weeks to rest and to gain some his os 
Well, Pye had enough rest, I've been be uct mi 
pital for more than a year, But they don’t w 
to go home yet, ] don’t understand it. sonal dia 

T. The truth is that you have an emotion pis 
turbance. That’s why you are in this hospital. 
i i 5 do 
3 P On a my father knew what he was 
ing. 

T. What do you mean? I 

P. I couldn’t control my emotions when uldn’t 
home. I was blowing my top all the time, co here í 
keep a job, afraid of Peop!z, I had to come uP 
to straighten out all that, | 


It 
can 
T. What about not understanding why you 
get out yet? 


ite 
i i traig! 
P. I guess that will have to wait until I 5! 
en myself out a lot more, 


d 
n 
The administrative problems of aarda in | 
hospital, as they affect the patient, ed 
themselves be considered a part of group t 
apy. It should be quickly pointed out to no 
Patients, that the Purpose of the therapy is pr 
to grant passes or leaves of absence, assign ad 
tients to work details, or engage in ig oO 
ministrative duties of this nature. These fac in 
are certainiy considered by the theraps i 
terms of what arises in therapy. However, 
therapist reinforces his position in the group 


í a 
2 person sincerely interested in helping the P 


jal 
tents get better, rather than one who essent 
Y grants or denies p 


rivileges, 


i 
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The solidarity of the group is emphasized by 
assigning the patients to the same sleeping and 
eating quarters, the same work details, and in 
general keeping them together on many hos- 
Pital activities. While these procedures may in- 
volve considerable administrative difficulty, 


a have been found to be therapeutically 
eneficial. 


i The making of tape recordings and playing 
em at the subsequent session has been found 


t 5 
_ to be a useful technique for enabling the group 


= “oe a — objective and less distorted view 
be os ~~ frequent reaction is surprise at 
Uher pi feeling displayed about a given 
ea z izopren patients in particular 

aine th rive a great deal of satisfaction from 

hey P er own voices and are eager to listen. 
PE ae the playing of the record- 
oa ee = orate something which they have 
sion, o = speak of other aspects of the discus- 

tand end of playing one such recording, 
Wo keas reed by two patients, one of these 
alt oe a the other and said, “Let’s you 
the unk ee a back seat next time and give 
Sok i ead a chancé.” The following 
tajė E e review of a previous session by 

Ee < ne enables a patient to interpret 
ateria] ymbolic utterance and to present new 

rial for further therapeutic exploration. 


P. ; 

Ss felt like I was choking, like there was a rope 

Pirate, aad neck. Maybe one of my ancestors was a 

and T wet maybe I was a pirate in a previous life 

a ship, as hung by theneck from the yardarm of 
lt 

P ap were you being hung? 

X , 

‘eek ah know. I never committed any crime. 
only eri interrupts recording at this point.] The 
self, I mes I have ever committed were against my- 
away. oe thinking about how I threw my life 
Pirates I at choking feeling has nothing to do with 

ought t was my own disgust with myself and the 
Si of suicide coming out in the form of a 

ptom. That’s what it was. 


ee opie nee with the tha apist are 
Ob when 2 t e patients when they so desire 
‘whens e therapist feels that a patient might 
A to the ward in an agitated state. It was 


<an o eog oe x 
4 one of these individua] sessions that a pa- 


ti : 

hie dei, for the first time, that he had 

T i ideas. Others have been able to talk 

a t fantasies or impulses which they had pre- 
usly suppressed. ; 
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Results 


In our initial meetings with these patients, on 
the more inactive wards in the hospital, many 
of them were very withdrawn, apathetic, autis- 
tic, uninterested in the environment, and un- 
aware of their own lack of personal tidiness and 
crude behavior. In no case did the patients ap- 
pear to have any understanding of, or any in- 
terest in, group therapy. The first few ses- 
sions in the group found them to be uncom- 
municative and withdrawn, they showed no in- 
terest in the other patients or the therapist, and 
mainly sat for the entire time lost in their own 
preoccupations. 

At the present time we see most significant 
changes in the patients’ interpersonal experien- 
ces and behavior. The group meetings are ac- 
tive and alive, often with several patients try- 
ing to talk at the same time. They are inter- 
ested in themselves and their environment, and 
even more noteworthy, they have demonstrated 
an increasing interest in each other and in the 
therapist. In addition, many of the patients 
have become interested and engaged in hospital 
activities and work details. In one case, an en-_ 
tire group was transferred to a rather active, 
ward on which they are all assigned to work 
details, engage in athletics, and regularly at- 
tend hospital parties and movies. 

‘These patients have made definite advances 
in achieving better emotional adjustment, and 
they are highly motivated for and better cap- 
able of receiving intensive psychotherapy. We 
feel that the therapeutic techniques employed 
have enabled us to penetrate long-standing 
psychic barriers and to initiate more healthy 
and gratifying modes of adjustment in pa- 


Table 1 
Hospital Status of Psychotherapy Group 
and Control Group After One Year 


Control Therapy 

Status group group De ? 
On More Disturbed 

Ward 4 (14%) 6 (21%) £9 42 
Unchanged 18 (64%) 5 (18%) 3.53 0004" 
On Improved 

Ward* 1( 4%) 13 (46%) 3.39 .0008 
Discharged or 

Trial Visit 5 (18%) 4(14%) «37 .70 

Total 28 28 


other pstients 


* Wards requiring better adjustment to 
the hos- 


and personnel, and more active participation in 
pital program. s 
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tients who might have otherwise remained life- 
long, regressed schizophrenics. 

It is apparent from Table 1 that there are no 
significant differences between the therapy 
and control groups in the “More Disturbed 
and “Discharged or Trial Visit” categories. On 
the other hand, in the “Unchanged” and “Im- 
Proved Ward” categories, the differences in fa- 
vor of the therapy group are very large. In the 
control group, 64% are unchanged, compared 
with 18% of the therapy group. This differ- 
ence is significant at the -0004 level. In the 
therapy group, 64% are improved, compared 
with 4% of the control group. This difference 
is significant at the -0008 level. 

When the status Categories were combined 
into Improved (On Improved Ward plus Dis- 
charged or TV) and Unimproved (More Dis- 
turbed Ward plus Unchanged), a chi square of 
9.02 was found, indicating a probability of less 
than one in a hundred that the differences be- 
tween the therapy and control groups are due 
to chance. These results are in the same direc- 
tion as those obtained by Powdermaker and 

a Frank [6, ch. XVII] and by Feifel and 
Schwartz E33, 


Summary 

This paper describes 
authors, some of the m 
apy techniques, whic 
for a period of one yea 
ic schizophrenic patie 
ting. A clinical evalu 
provement is offered, 
Parison with a contro 
heoretical assum 
techniques have been 


, in the opinion of the 
ore effective group ther- 
h were actively applied 
r to four groups of chron- 
nts in a large hospital set- 
ation of the patients’ im- 
as well as statistical com- 
l group. 


the therapist, the 
ess. 


Joseph M. Sacks and Stanley Berger 


Illustrations from recorded transcriptions of 
group therapy sessions are given as concrete il- 
lustrations of several of the points presented. 

It is hoped that the presentation of this ma- 
terial will stimulate greater interest in the 
chronic schizophrenic patient, and that con- 
tinued efforts will eventually discover thera- 
peutic techniques that will prove fruitful and 
efficacious in restoring these patients to a more 
satisfactory way of life, 
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Given interview 
Fi lengths, or fullness, however, one may ask 
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The Influence of Fullness of Interview on the 


Every interviewer has had the experience of 
talking both with laconic and with verbose re- 
spondents. For clinical purposes, the length of 
response may in itself be a significant factor. 
However, when interviews are used to gather 
research materials—that is, when the responses 
will be quantified and related to other vari- 
ables—we may ask how the fullness of the re- 
sponses affects the judgments made on the inter- 
view, assuming that both the short and the 
long replies are codable. 


Factors determining the length of replies 
have not been widely examined. Both Shapiro 
and Eberhardt [4] and Feldman, Hyman, 
and Hart [1] found that there was wide vari- 
ability among interviewers as to how much they 
probed the respondent. It is likely that the 
more extensive the probing, the longer the in- 
terview. Doubtless the general verbality of the 
respondent also influences the length. 


responses of different 


` what influence this factor has on the reliabil- 
ity, discriminability, and validity of the coded 
Judgments made from the material. A set of 
379 transcribed interviews obtained in connec- 
tion with a study of maternal child-rearing 
Practices has offered an opportunity to make 
Preliminary tests of three hypotheses. 

Three kinds of codes were used to quantify 
the interviews: (a) item codes (henceforth 
abeled I) required judgments on responses to 

*This article is based on data drawn from a study 
“pn be Identification in Young Children,” conducted 
Bae Harvard Laboratory of’ Human Development 
and the direction of Professor Robert R. Sears, 
sa 1s supported by a grant from the National In- 

itute of Mental Health (M-461). The author 


joshi to thank Dr. Eleanor-E. Maccoby for her 
elp with the article. 


Reliability, Discriminability, and Validity 
of Interview Judgments’ 


Harry Levin 


Harvard Graduate School of Education 


single specific questions; (b) summary codes 
(S) involved judgments based on a group of 
three or four questions; (c) over-all codes (O) 
took into account material which occurred not 
only in response to specific questions, but also 
at various points throughout the interview. 

The following hypotheses were tested: 

1. Reliability on all three types of codes is 
higher for the short than for the long inter- 
views. The reasoning is that the added mate- 
rials lead to different interpretations by the 
coders. 

2. Discriminability of judgments is greater 
for the long than for the short interview. This 
prediction is based on the idea that more ma- 
terial in the interview permits finer discrimina- 
tions among respondents. 

3. Long interviews lead to more valid judg- 
ments than short interviews. It seems likely 
that added materials lead to judgments which 
are “truer” to behavior than are those based 
on sparser materials. 


Procedure 


Three hundred and seventy-nine mothers 
were interviewed about various aspects of their 
child-training procedures. A standardized in- 
terview schedule was used, consisting of a list 
of open questions which the interviewers were 
trained to use without change in wording and 
in the prescribed order. Following each of the 
main open questions was a seriès of suggested , 
probes which the interviewer was free to use 
or omit, depending on the fullness of the an- 
swer to the original question. The interview 
took between one and a half to two hours, on 
the average. 

The interviews were recorded on an Audo- 
graph and later transcribed .into typescript. 
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On the basis of the number of records used to 
complete the standard interview, two extreme 
groups of 50 respondents each were chosen. 
The “long” interview group was made up of 
40 people who talked for approximately two 
and a quarter hours, and 10 who talked for 
more than two and a half hours. The “short” 
interview group contained 25 respondents who 
completed the interview in less than one hour, 
and 25 respondents who took about one anda 
quarter hours to respond to all of the questions. 
The two extreme groups chosen for this com- 
Parison differed by approximately one hour, on 
the average, in the length of the interviews.? 

The 100 interviews considered in this re- 
port were taken by ten different interviewers, 


two interdependent factors: the interviewer’s 
technique and the amount that the respondent 


Typescripts were made from the rec 
“and 188 judgments, i 


judgments on each interview and 
then reached a “pooled” 


ing their ratings, R. 
each of a group o 
€very other judge 

or the various analyses discuss 


Sent study, five scales each of the I, S, and O 
types were selected. 


Results 
j The comparison 


in each: groupewere not codable. 

Reliability of judgments, Since two coders 
made the judgments on each interview, the 

2Since the recorder 
rate, it was Possible for 
to say more in a given le 
correlation between 
mined by number of dises 


Harry Levin 


“codes encompassing more 


correlations between their ratings prior to poo e 
ing provide an index to the reliability of ili 
ing. In Table 1 it can be seen that the relia 1 3 
ties on the item scales were in every instanc 
higher for the short than for the long inte 
views. On two of the item scales the differen 


Table 1 À 
Two-Coder Reliability of Item Codes Based on 
Long and Short Interviews 


Scales be 
Ii 12 13 14 ā B” 
> 50 od 
Long interviews -50 65 65 52 A d 
Short interviews 36 82.74 © .76 A 
trir 3.57%% 1.83 .84 2.01" 1. 
v2 


** Significant at the 1% 


level. 
* Significant at the 5% 


level. 


ces between the reliabilities are statistically | 
significant, and on two other scales the dif- \ 
ferences approach significance, | 
From Tables 2 and 3 it can be seen that, 
with one exception, the reliabilities of judg- | 
ments on summary and over-all codes are sim” | 
ilar regardless of the length of response. Scale 
O-4 dealt with thë “mother’s esteem of father 
and was one of the most highly inferential 
scales used. It is interesting to note that when 
the basis for the judgment was scattered 
throughout the interview, was not based of 
any specific questions, and involved a great 
deal of inference by the coder, long interviews, | 
Providing more material, permitted higher F 
agreement among the, judges. In general, apt 
though, when the code is based on a specific re-~» 
Sponse, emendations and elaborations of the re- 
sponse detract from intercoder agreement. On 
material in the inter- 


view, length of response has little influence 
on reliability, 


Table 2 


Two-Coder Reliability of Summary Codes Based 
»_ On Long and Short Interviews 


$ S-1 8-283 54 S-5 
Long interviews 74 60 44 


Short interviews 


Tifo 


Discriminability of judgments. In research | 
Interviews, on the basis of which coded vari- | 
ables will be related to other variables, it is @ | 


Ẹ 


D 


| 
| 


iM 


> 


& 


Prime requisite that the judgments discrimin- 
ate maximally among respondents. With the 
variability of judgments as a criterion, the var- 


Table 3 
Two-Coder Reliability of Over-all Codes Based on 
Long and Short Interviews 


Scales 
0-1 0-2 0-3 0-4 0-5 
Long interviews 74 58 71 72 33 
; Oi interviews $2 75 75 37 42 
Tira .99 1.49 41 2.49** 50 


** Significant at the 1% level. 


lances of the 15 codes on the long and short 
interview groups were computed, and the 
significance of difference between the “long” 
and “short” variances was computed. The re- 
sults are given in Table 4. Of the 15 compari- 
sons, three of the variances based on the long 
interviews are larger at the 59 level or better, 
and on one scale the variability of scores based 


es Table 4 
ariances of Judgments on Long and Short Inter- 
views for Item (I), Sumrlary (S), and ` 
Over-all (O) Codes 


~ Variances Variances 
ale , long short 
interviews “interviews F 

a 89 1.14 1.28 
es 1.41 1,58 1.12 
F 1.01 .97 1.04 
i 3.06 1.13 2.71%% 
a 100 ? 1416 1.16 
F 99 94 1.05 
F 2.40 2.53 1.05 

‘ -60 -70 1.17 
8-4 1.33 95 1.40* 
8-5 2.25 1.78 1.26 
O-1 1.70 1.56 1.09 
0-2 .91 1.42 1.56* 
0-3 2.15 2.20 1.02 
0-4 1.87 1.44 1.30 
O-5 7.82 5.07 1.54" 


#8 Sieni 
z Sisnificant at the 1% level. 
lgnificant at the 5% level. 


o r : hin Sect 
n short interviews is significantly greater. 
. OWever, the mean of the long interview var- 


$: : ce . , a 
» «lances is not significantly different from ‘the 


mean variance of the short interview judgments 
Festinger’s d = .86) [2]. 
Validity of judgments, An ideal validity 
check would be to compare the judgments 
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made on the interviews with the overt behay- 
iors which the scales purport to measure. 
Since this was not feasible within the limits of 
the present study, a criterion of logical validity 
was used, that is, the utility of scores in generat- 
ing predicted relationships with other variables. 
Based on the total 379 interviews, an analysis 
of social class differences in child-rearing 
practices was carried out. It was found that 
9 of the 15 scales being discussed in the current 
study were highly related to the social class 
memberships of the respondents. For example, 
there is more frequent use of physical punish- 
ment (Scale O-2) in the lower than in the 
middle class. Following the analysis of the 
total sample, specific predictions about the 
long and short interview groups were made as 
to how the variables would relate to social 
class membership. Within the limits of the re- 
liabilities of the scales, it would be expected 
that the more valid the scales, the more clearly 
they will relate to social class. 

To test these relationships, the long and 
short interviews were divided into higher and 
lower social class, and the means for each 
scale were calculated. In Table 5, the differ, 
ences (d) between the means for the two 
social classes within each length-of-interview 
group are presented. The stronger the rela- 
tionship to social class, the larger should be the 
d score. For example, for Scale I-4 (How Far 
is Child Expected to Go in School) the rela- 
tionship is obviously higher for the short inter- 
views, since there is a larger difference between 
the means, than in the long interviews (1.36 
compared to .49). 

If we sum the d scores separately for each 
type of scale, we find that there is a sizable d 
score for the item scales in favor of the short 
interview group; that is, the relationship of 
the variables to social class is higher for vari- 
ables measured on the basis of the briefer inter- 
views. These findings are in line with the 
higher reliabilities of the item, scales, as re- 
ported in Table 1. It might be expected that, - 
if the longer interviews permitted more valid 
judgments, the lower reliabilities of the long 
interview judgments might be somewhat over- 
come, thus equalizing the d scores. Such is ob- 
viously not the case. 


8This study is reported in detail in [3]. 
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4 
4 
A 
Table 5 6 
i 7 Selected Scales 
Means and Differences between Means on ; 
Aoroa to Length of Interview and Social Class of Respondent 
Short interviews Long —— 
High social Low social a Low ai | 
class class class ola 
Scale no. Name wE S d (N=33) (N=17) d 
I-2 Permissiveness for 83 
masturbation 2.64 1.70 94 2.74 1.91 / 
I-4 How far child expected as l 
to go in school 4.88 3.52 1.36 4.55 4.06 (a 
I-5 Demonstrativeness: 08 
3.24 
mother to child 3.38 3.32 5 L 3.32 S= 1.40 : 
S-1 Severity of toilet n 
S 2.36 2.32 -04 2.53 3.24 i20 
S-2 Mother’s sex anxiety 3.02 4.66 1.64 3.36 4.56 
S-4 Permissiveness for ag- 66 
gression toward parents 2.40 1.64 5 Ee i 2.42 1.76 P | 
| 
0-2 Use of physical 
punishment 3.16 3.90 74 3.26 4.00 4 
0-4 Mother’s evaluation of A 
father 5.02 4.92 10 5.17 4.26 3 
O-5 Agents of caretaking 3.26 2.20 1.06 3.89 


cy of pre- 
favor the 
the long interviews; 
Scores are equal. The 
e S and O scales are 
contrary to our orig- 


Sums of d scores on th 
very similar, Therefore, 


inal expectations, on none of the three types 
of scales did added length of response appear 
to increase the accuracy of predictions, 


Summary and Conclusions 
Fifty long and fif 


ty short interviews con- 
ducted with a stand. 


ardized open interview 


nses as the 


ong interviews. g findings 


emerged : 3 

1. When judgments ar 
section of the interview, 
is higher on the short int 
differences in reliabiliti 
on long and short int 
propriate material is ba 
tions scattered throug! 

2. There are no 


e made on a specific 
intercoder agreement 
erviews. There are no 
es between judgments 
erviews when the ap- 
sed on a group of ques- 
hout the interview, 

differences between the 
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ability of long arı 
view judgments ti 
dents. 


3. When validity is judged by the utility of 


d the ability of short inter- 
o discriminate among respon 


the ratings in 
other variables, 
equall 
rials ii 
that j 


generating relationships with 
long and short interviews are 
y valid on lengthy and Scattered mate- 
n the interviews. There is a suggestion 
udgments on a specific section of the LOPTE 
terview are more valid in the short interviews, 
although this may be a reflection of the higher 
reliabilities of these judgments. 
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Gladwin, Thomas, & Sarason, Seymour B. Truk: 
man in paradise. New York: Wenner-Gren 
Foundation for Anthropological Research, 1953. 
Pp. 651 + 8 plates. $6.50. 


Long aware of the values of anthropological 
studies for their work, clinicians will find this 
monograph particularly relevant and stimulating. 
In the first place, it represents at a still more so- 
phisticated and insightful level the kind of collabo- 
ration between anthropologist and psychologist that 
made the Dubois-Oberholzer study of the Alorese 
so seminal for both disciplines. Second, since it is 
one of a series of investigations of Trukese culture, 
this report is unburdened with such specifically eth- 
nological matters as linguistics, formal social struc- 
ture, systems of property ownership, and the char- 
acter of the material culture. Its content is concerned 
entirely with Trukese personality development and“) 
the sociocultural matrix within which it finds ex- 
pression. Consequently, it deals with the problems of 
greatest moment to American clinical psychologists 
but from a point of view that permits a valuable 
perspective. Third, the book is crammed with ex- 
tensive life histories and excerpts from projective 
test protocols. These materials will excite the im- 
agination of all who use such data in their daily 
work and provoke fruitful hypotheses among the 
thoughtful for testing in both clinical and research 
contexts. This fat volume is at once lively and ser- 
ious, and it contributes both to an understanding 
of the conditions affecting personality development 
and of the techniques by which it is conceptualized 
and investigated. — E. J. S. 


Greenacre, Phyllis. (Ed.) Affective disorcers. New 
York: International Universities Press, 1953. Pp. 
212. $3.00. 


4 symposium of five papers, mainly on depres- 
sion, presented before the American Psychenalyt- 
ic Association in 1950 and 1951. Edward Bibring -. 
and Edith Jacobson are in agreement that de- 
pression is a helplessness reaction with loss of self- 
esteem, and both have difficulty in reconciling the 
view with some earlier analytic interpretations. 
Elizabeth Zetzel presents an extended apology for 
Melanie Klein’s theories. George Gero gives an in- 
teresting case of anorexia is an equivalent of de- 
pression. M. Katan views both depressed and man- 
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ic symptoms as mechanisms of denial and restitu- 
tion. — L. F. §. 


Harms, Ernest. Essentials of abnormal child psy- 
chology. New York: Julian Press, 1953, Pp. xiii 
+ 265. $5.00. 

In this book, the author Presents his views of 
the genetic development of the child, before discuss- 
ing therapy and diagnosis. He considers the concept 
of infantile sexuality quite inadequate, and the par- 
ental relation to be beyond sexual experience. The 
relationship to the father is described under the rub- 
tic of paternus and to the mother of materna, which 
he considers to be inherited archetypical 
comparable to Jung’s animus and anima. His dis- 
cussion of case material and specific diagnostic cat- 
egories follows his conviction that different tech- 


factors 


he use of 
c means, will be of particular 
interest to psychologists. — 4, R. 


Pennington, L. A, & Berg, Irwin A. (Eds.) An 
introduction to clinical Psychology, (2nd Ed.) 
New York: Ronald, 1954, Pp. vii + 709. $6.50. 
This is an excellent texi 

“æ Students an overview of the whole field of clinical 

Ø psychology. Its editors h 

principles rather than the 

niques, Although there is a 


chapters are added, It should 
troductory course in clinical 
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k ws heavily on 
Mowrer, Berlyne, Skinner, Dollard and Miller, and 


New Books and Tests 


New York: Ron- - 


ny 


Be m he 
Brown and Farber. Observation, inference, byron 
esis making, and assessment are illustrated by 


studies of counseling. Assessment, is approached ia 
alistically, with a cogent discussion of criter 

variables. This book may help to make counselors 
and psychotherapists—more aware of the re. 
tions that they bring to their contacts with clie Me 
As a text, it may help students to sec the ne 
relationships between science and practice. — LF. 


Stott, D. H. Saving children from delinquency. ree 
York: Philosophical Library, 1953. Pp. x + 
$4.75. oe 
Stott has placed the emphasis upon “avinai 

children from delinquency—by prevention if P 

sible, and by avoiding further difficulty aen 

linquency has occurred. The illustrations an Res 
uations are typically British, but the amr 

reader will find much to help him in meeting g 

own problems since the basic needs are simi p 

Visiting teachers, probation officers, and oom 

workers will find the book very readable and st! 

ulating. — B. M. L, 


Vedder, Clyde B. The juvenile offender: persis 
tive and readings. Garden City, N. Y.: Doub! 
day, 1954. Pp. xii + 510. $6.00, a 
As the subtitle indicates, this book is a solee 

of readings from Periodicals dealing with the subje F 

i The 71 reprinted articl 

are organized into 13 chapters, under headings i 

Delinquency,” “Economi? 

Factors,” “Special Persons 

ems,” “Probation,” and th 

with a brief discussion 0 


are represented j 
but 90% are from 
Federal Probation 


vree book for the student of juv“ 
= M.K. 


Wolffheim, Nelly, Psychology . 
(Trans. by Charles L. Hannam.) New York? 
Philosophical Library, 1953, Pp. 144, $3.75. 

à Psychology in the Nursery School is a transla” 

Which A work originally ‘published is eenaa 


A l 
in the nursery schoo 


n, and should lead to new 
She believes that psychoan- 
th the teacher and her € 

she feels it would be a de- 


Ways of studying them, 
alysis would benefit bo 


ucational work; in fact 


| 


Îi. sirable part of the professional training of teachers. 
The book is challenging but not very practical. The 
author admits that her point of view is based on 
| theoretical studies and experiences in small nursery 
schools only. — B. M. L. 
f 
Tests 
\ Barrens; Bessie B., Blum, Lucille Hollander, 
Pie Irving. Columbia Mental Maturity Scale. 
N ae 3-12, Individual test. 1 form. Untimed, 
ps o min. Kit of 100 test cards, with manual, 
a ti : ($35.00); record blank (85¢ per 35). 
p onkers, N, Y.: World Book Co., 1954. 
a ine research project culminated in the 
f RA aa ent of this unique individual intelligence 
Es, pened for the needs of children with cereb- 
| 3 Palsy and other severe motor or speech handi- 
l a The materials are 100 large cards, 6 by 19 in., 
| in ieee from three to five drawings, many 
silace is “he task is the same for each item: to 
$s Mon Paure that does not belong with the oth- 
Ena 2 ren point to the figure; handicapped 
W- can sito hd © can only nod or make a sound 
standardi i examined successfully. The test was 
| i scare f on 957 normal children from 3 through 
| palsie da and also tried with 147 cerebral 
mal childr ren. In single-year age groups of nor- 
from 46 es its corrected odd-even reliability is 
ford-Binct r, 2, and its correlations with the Stan- 
value of Cees from .66 to .88, with an average 
ise in dira ‘75. The test will surely find wide 
handicapped week and research with the severely 
struments for t is not likely to replace existing in- 
features of fe testing normal children. The very 
handicapped pony that make it suitable for the 
tions often ‘sorta the useful auxiliary observa- 
mance tests with e by verbal tests and perfor- 
(Qywell-standardt „varied tasks. Even so, another 
clinical ized intellig_nce test is a real asset to 


S; > z 
authors’ ee Se » and may find uses beyond its 
ginal intentions, — L, F, S. 


x 
Eisens eh 
oler oen. Examining for aphasia. (Rev. Ed.) 
with a ult. Individual test. 1 form, Manual 
Pp. 12, ($3.50 n v + 73 ($3.50); record form, 
| 3 sychological e a (E600); ao Kori 
is u * 4 
greatly 1a a eg eats for aphasia do not differ 
| scheme of te their first edition of 1946. The broad 
Provements oe Temains the same, with some im- 
| rangement ce es Pictorial materials, ii’the ar- 
© Braphs for aM el and in the selection of para- 
tion for ankea and silent reading. An examina- 
tests therefore p 38 necessarily qualitative, and the 
‘ards for seid be judged by the, usual star:d- 
quantifications Pe and validjty. Some approximate 
| Ver, at least fee these tests would be helpful, how- 
whether the a give an examiner clues for judging 
ate” or “seve isability in a given area is “moder- 
revised than if The manua! is more extensively 
the test itself, the first 28 pages com- 
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prising a miniature textbook on nature, symptoms, 
and varieties of aphasia, and the examination of 
aphasic children. Perhaps because of its condensa- 
tion, this introductory material tends to be arbitrary 
and uncritical. Still, it provides a useful check list 
of definitions and procedures for the use of exper- 
ienced psychologists. — L. F. S. 


Wesman, Alexander G., Verbal Test, & Doppelt, 
Jerome E., Numerical Test. Personnel Test for In- 
dustry (PTI). Trade school-adult. 2 forms, each 
test. 5 (10) min, verbal; 20 (25) min, num- 
erical. Test booklet, each test ($1.60 per 25), with 
manual, pp. 10, and keys; specimen set (35¢). 
New York: Psychological Corp., 1952, 1954. 

The verbal and numerical tests introduce a new 
series of Personnel Tests for Industry which is to 
include tests of other abilities and skills. The ver- 
bal test is a 50-item, multiple-choice vocabulary 
test, and the numerical test a series of 30 arithme- 
tic problems based on industrial tasks. The manual, 
modestly designated as preliminary, gives extensive 
information about reliabilities and the prediction 
of criteria, based on industrial workers, and percen- 
tile norms derived from several industrial samples 
and one trade school sample, totaling some 1400 
cases. Although conventionally conceived, the tests 
show the application of high professional standards. 
They illustrate the trend toward the construction of 
tests especially designed for adults in industry. — ,, 


L, F. S. w) 


Books Received 


Abramson, Harold A. (Ed.) Problems of conscious- 
ness. New York: Josiah Macy, Jr. Foundation, 
1954. Pp. 177. $3.25. 

Anastasi, Anne. Psychological testing. New York: 
Macmillan, 1954. Pp. xiii + 682. $6.75. 

Burmeister, Eva. Roofs for the family. New York: 
Columbia Univer. Press, 1954. Pp. 203. $3.25. 

Caplow, Theodore. The sociology of work. Minne- 
apolis: Univer. of Minnesota Press, 1954, Pp. 
viii + 330. $5.00. 

Commins, W. D., & Fagin, Barry. Principles of ed- 
ucational psychology. New York: Ronald, 1954. 
Pp. xvi + 795. $5.75. 

De Sade. Selected writings. (Trans. by Leonard de 
Saint-Yves.) London: Peter Owen, and New 
York: British Book Centre, 1954. Pp. 306. $6.75. 

Freud, Sigmund. The origins of psychoanalysis: 
letters to Wilhelm Fliess, drafts &ıd notes. 1887- 
1902. New York: Basic Books, 1954. Pp. xi -+ ” 
486. $6.75. 

Fryer, Douglas H., Henry, Edwin R., & Sparks, 
Charles P. General psychology. (4th Ed.) College 
Outline Series. New York: Barnes & Noble, 1954. 
Pp. xix + 300. $1.50 (paper). 

Gorer, Geoffrey. The life and ideas of the Mar- 
quis de Sade, London: Peter Owen, and New 
York: British Book Centre, 19%. Pp. 244. $3.50. 


> 


310 


Martin, John Bartlow. Break down the walls. New 
York: Ballantine, 1954, Pp. 310. $3.50 (cloth), 50¢ 
(paper). 

Pitt, William J. & Goldberg, Jacob A. Psychology. 

New York: McGraw-Hill, 1954. Pp. 414. $4.50. 

Remmers, H. H., Ryden, Einar R, & Morgan, 
Clellen L. Introduction to educational psychology. 
New York: Harper, 1954, Pp. ix + 435, $4.00. 

Runes, Dagobert D. Letters to my daughter. New 
York: Philosophical Library, 1954. Pp. 131. $2.59. 


New Books and Tests 


Ryan, Thomas Arthur, & Smith, Patricia cin 
Principles of industrial psychology. New York: 
Ronald, 1954. Pp. xiv + 534, $5.50. 

Schwing, Gertrud. 4 way to the soul of the men- 


tally ill, New York: International Universities 
Press, 1954, Pp. 158. $3.00. 


Wulfeck, Joseph W., & Bennett, Edward M. The 
language of dynamic psychology as related t0 


motivation research. New York: McGraw-Hill, 
1954. Pp. 111. $4.00, 
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n any attempt to consider the current role 


on rchodiagnostic testing in clinical psychol- 
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ie a shades of thought characteristic 
cal scene. 
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given much, perh; 

to the varied poli 


this or that pers 
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dia of current opinion have 
aps too much, consideration 
tical philosophies adopted by 
: on. Liberal, conservative, na- 
have bene leftist, rightist, etc. 
Probrium, T A ot terms of approval or op- 
chologists oe & sesser degree, it seems that psy- 
ellow ‘adit a, as likely to stereotype their 
Characteristic The 7 aN ually superficial 
Mentalist p lz ir, clinician decries the experi- 
human; the eS ing in certain qualities, chiefly 
Nician by io ee condemns the cli- 
Phrase, e's a the telling, | if overly used, 
other aa gr Ge Clinicians war with 
rawn,” B aR a = battle lines are 

Projectivists, objecti s clashing with the non- 
Statisticians os oe with the intuitionists, 
“reudians wi n the qualitative analysts, and 
vith the ‘non-Freudians are illus- 


trative 
of ETI 4 
of us be the strife in which each and everyone 
> ecomes involved. j 

n this e É : 
trends in evaluation of the current major 


5 dia í - p $ 
anticipate o gnostic testing and in trying to 


ture, the hs Opes or expectations of the fu- 
"iter, too, finds himself forced into 


the u 
Se of labels, With this injected note of 


Warnin f; 
Writer E possible oyersimplification, the 
label, į wish to consider the trend, or 


i illustrateq by 


as designated as bes school of thought he 


a nservative. The conserva- 

agnostic ines Monstrate the validity of his di- 
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than pri i 

h Primary; it seems to be an all- 
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“rent Trends į £ the symposium, “Assessment 
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encompassing one. This evaluative statement 
should not be construed as an attempt to decry 
validity and/or reliability studies, nor is it a 
passing glance at superficially recognizing the 
need for such studies only to embark on a series 
of psychological speculations which lack any 
scientific basing. It is a matter of concern, how- 
ever, that the literature abounds in numerous 
studies which by their design seem almost des- 
tined to purposefully devalue certain tests. 


As an example of the validational or so- 
called scientific approach, a study by Witten- 
born illustrates the grievous principle when he 
says, “One of the outstanding characteristics 
of the Rorschach responses is their highly indi- a? 
vidual quality, their extreme variability from 
person to person. This makes conventional 
statistical treatment of Rorschach data awk- ~ 
ward because of the difficulty in securing a 
large number of roughly identical responses. 
For example, out of a group of one hundred 
normal subjects many, if not all, would report 
human movement responses but relatively few 
would have more than two, or at the most, 
three identical responses in common. In the 
present study an attempt has been made to re- 
duce this difficulty by the use of the Harrower- 
Erickson checklist” [6, p. 258]. Wittenborn 
then notes that some question has been raised 
as to the validity of this check list for diag- 
nostic purposes, but defends his use in this par- 
ticular study since he wants to investigate the 
interrelationship of various scoring facters, spe- 
cifically, movement and color. It would seem 
that such a defense is, at best, questionable, 
since if the check list is invalid for diagnostic 
purposes, then one would logically question 
whether or not the responses gained from such 
a pzocedure could permit one to make sound 
inferences about the Rorschach method in its 
clinical setting. Moreover, itzwould seem that 
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there is a potential danger to the reasoning 
which Wittenborn uses. According to his rea- 
soning, if we have a particular test which fails 
to lend itself to being treated by orthodox sta- 
tistical procedures, then the test itself must be 
altered so as to render it suitable for statistical 
manipulation. The reasoning is something like 
this: a switch to an invalid check list permits 
the data to be processed statistically. In other 
words, if a particular phenomenon can’t be 
measured, measure an artifact of the phe- 
nomenon. On the basis of data gained from 
measuring the artifact, one can then turn to 
generalizing about the original phenomenon. 
As illustrative of the dynamicist or the “rad- 
ical” approach, one can turn to Gurvitz’s vol- 
ume, The Dynamics of Psychological Testing 
[3]. In a particular instance, he is evaluating 
the association a patient made to a female fig- 
ure drawing. When asked for the worst part 
of the drawing, the patient replied “Toe nails; 
they’re ingrown, that’s why she’s not wearing 
shoes.” Later on, in his analysis of the test pro- 
tocol, Gurvitz says, “The ingrown toe nails 
© appear to represent the self-punishing and 
í “masochistic elements in the personality” [3, pp. 
116-119]. The existence of masochistic and self- 
punishing elements in a personality as stated 
is of no moment, Actually it would be a far 
more unusual statement in a psychological re- 
Port if one could read that patients’ maso- 
chistic and self-punitive elements were of little 
Import in their personality. Certainly it is diffi- 


cult to rule out the possible existence of such 
elements in personali 


however, questio 
ference was made. 


Apparently many diagnosticians are doing 
what some psychoanalysts did a number of 
years ago (some still do) in attaching undue 
importance to everything that a Person may 


say. Also, ‘¢ would sem that we are in danger 
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of covering our failure to understand certain 
personality operations by trying to couch our 
reports in high-sounding, esoteric language, 
which simply serves to make the person so de- 
scribed something less than a living being. One 
need not be unmindful of the danger that at- 
tempts to make reports too individualized may 
lead us on an unscientific road. If we get to? 
enamored with our own literary geaten 
so that we neglect to make certain genera 
statements which should be made about an ed. 
dividual, then an injustice is being perpetratec 
When these general statements become “he 1S 
an immature individual” or “his problems % 
hostility have not been solved” or what has now 
become the most cliché of psychological cliches» 
“his intellectual efficiency does not measure uF 
to his intellectual potential,” then it would va 
pear that our reports have become jaded, lac A 
ing in specific statements about an individuā » 
and are becoming a mass of generalities which 
unfortunately don’t even glitter. 

Holt’s analysis of the TAT of Jay, a case 
study, illustrates too well the point. Before 
setting down to analyze the results, Holt gives 
his ESP interpretation. “As a kind of control 
I decided to set down, before looking at the 
TAT some of the truisms and clichés that a°¢ 
found in most test reports, and that can, 
fairly safely said once you know someone iS # 
patient of Jay's age and sex” [5, p. 457]. Then 
follows this ESP interpretation, which makes 
perfectly good reading znd is just as definitive 
as many psychological reports that thrive i? 
case files throughout the country. 

Much of what has been said has concerned 
itself with the varying attitudes held towar 
projective tests. Many of the same observ 
tions can be made if we examine the area A 
intelligence testing. The following statement 
are found in Patterson’s manual: “His ja oe 
judgment is relatively superior, indicating tha 
he has been capable of profiting by his expe!” 
ence. In contrast, however, foresight and plan- 
ning ability (Picture Arrangement) is poo": 

is poor performance may have been affected 
somewhat by his difficulty of attention and con- 
centration which may also have affected the 
Picture Completion and Digit Symbol as wel 
as the Digit Span tests. Picture Arrangement 
and the Similarities as well as Vocabulary may 
also be affected by cultural background. In 


i 


hy 


= ee, Ae 


The Current Role of Psychodiagnostic Testing 313 


the Picture Arrangement test, after success- 
fully arranging the first group of pictures 
from left to right, he arranged the next 
group from right to left and could give no 
anlan in when asked to; he immediately 
a a so series (the elevator) in a ver- 
EM cond § pp. 36-37]. Here again, we are 
py al sh ne pes that fail to ac- 
wil a cy sp elements in the data as 
whch has P y denying the interpretation 
dual E a given. If we have an indi- 
fale: tae Ae ae is relatively su- 
and plannin ya d seem that his foresight 
) koas 4 ility should also be superior. 
affected 1 Bone performance of a patient is 
tention 2 Si lack of concentration and at- 
then od well as poor cultural background, 
what an ‘edie are not permitted to infer 
ability are ya sai foresight and planning 
istractible x aybe we should say that he is so 
plan ahead hat we could infer he could not 
question Sheil a prudent manner. We must 
son's social a we have a measure of a per- 
high en a rient merely because he has a 
imply in iE omprehension. Patterson does 
judgment ig ee above that his social 
like prior ig os to what the patient was 
capable of n „iness and that he had been 
profiting from past experiences. If 
case, why mention a poor cultural 
da would certainly connote a 
ould ake ee to all of us, from 
= = sar Oaths, why is there no 
sn oe a which surrounds the 
Genial e Picture Arrangement test 
R ay Warrant considering it the 
ample eng individual. 
Eboni, rom Patterson, Gurvitz, 
from the literat ave been selected at random 
in diagnostic h ure to illustrate certain trends 
ticular studies esting, rather than as three par- 
quarrel. with which the writer wishes to 
in conclusions should-be drawn 
our need fo T studies. First, it seems that 
ad Purification of our diagnostic in- 
ecting h a - all too frequently into neg- 
extremely Bredie i, data, but then becoming 
Unprecise EE aed 3 our fneasurement of very 
strate our ata. Secondly, our need to 
Engikeininany s now-how” has caused us to 
a great numbe speculative statements, of which 
r cannot be validated because we 
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ackground 


ack of exp 
which he ¢ 


emphasis a 
Performan 
and whict 
Productio 
Nese 


and Witt 


have no criteria by which to demonstrate their 
validity. In other words, their world-wide ap- 
plicability to man makes our individual patient 
no different from anybody else in the world. 
Finally, we apparently seem unable to ever 
categorically and unequivocally state that we 
don’t know the answer to a particular question 
— in other words, that we just don’t have all 
the answers to all the questions. Rather we 
seem to get involved in a series of statements, 
some of which say one thing, followed by state- 
ments which deny what we have just said. Per- 
haps this is a tribute to our capacity for toler- 
ating ambiguity; it does not, however, make 
for definitive diagnostic interpretations. 

One should pause and consider some of the 
uses of diagnostic testing in a psychiatric set- 
ting. It would lead us far afield to consider 
the many different kinds of problems upon 
which we may be asked an opinion. We can say 
most referrals in a psychiatric clinic seek to 
know something about a person’s intelligence, 
both with respect to over-all capacity as well 
as strengths and weaknesses shown in the sepa- 
rate functions, something of the personality „ 
structure, some of the attitudinal constellations 
which are dominant in a person, etc. More 
broadly than this, however, is the implied ques- 
tion, “What sort of a person is this?” Pre- 
suming the person has pathology, what sort of 
expectation do we hold regarding the course of 
illness; what can we expect in therapy? The 
writer feels that most referrents are not pri- 
marily interested in how we arrive at conclu- 
sions, providing, of course, that we do not 
damage the patient in the process of reaching 
our conclusions. They are interested in our 
conclusions, either because they constitute a 
check on their subjective impressions or be- 
cause they reveal areas of personality function- 
ing which they had not been able to explore 
adequately. There is danger of belaboring the 
obvious, but it seems well to consider what we 
are doing before we try to say what wi should 
be doing. If we boil down the major functions 
of diagnostic testing as aiding in differential 
diagnosis, saying something about prognosis in 
or without therapy, and always recognizing 
that diagnostic instruments are useful research 
toois, why the need to assess the role of test- 
ing? The need to establish its role grows from 
a need to define its value. This concern is en- 
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hanced by the declining emphasis on diagnostic 
testing. In recent years clinical psychologists 
have shifted overwhelmingly in the direction of 
becoming therapists — and diagnostic testing 
has become confined by the “expert” telling 
the “nonexpert” how to examine and how to 
interpret results, what to do, what not to do, 
etc. Rarely does he do what he teaches. More- 
over, the “average” person who comes for 
training in clinical psychology usually has in 
mind training in therapy or doing research, 
and only secondarily training in the diagnostic 
study of patients. The reasons which under- 
lie the subordination of diagnostic testing to 
therapy and research are too numerous and in- 
volved to consider here. At any rate, the re- 
sult is evident. Diagnostic testing may be lik- 
ened to the status of a second-class citizen who 
is tolerated and endured but who is pegged be- 
low his superiors. 

The writer questions strongly the desirabil- 
ity of this rejection of diagnostic testing for 
therapy. In turning to therapy, clinical psy- 
chologists are neglecting areas of study which 

« could occupy their interest but which do not. 
(This feeling does not stem from any antihu- 
manitarian or antitherapeutic origin. Certainly 
psychological research in the therapeutic proc- 
ess will lead to some very valuable contribu- 
tions. The criticism, however, is that there are 
problems in clinical diagnosis which require 
careful study, and that these will be neglected 


as the clinical Psychologist focuses on being the 
Practitioner, 


Thus, all of us speak ver 
need to study the nor, 
words are, for the mo 
yourself how long it 
you wrote a report in 
tion was the keynote o 
a person’s many ina 


y seriously of the 
mal personality, yet our 


> or any of the 


Ptive psychiatrists, Instead, we 


speak knowingly of weak ego functioning, poor 
reality testing, latent schizophrenia, etc. until 
we are caught up in a series of ritualistic state- 


ments which, although colorful, fail to help us 
understand the patient. 


We are victims of wh 
Washington Post cartoo: 


at Herbert Block, the 
nist, in his The Her- 
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block Book calls Mumbo-jumbo. “One of the ( 


things that makes life complicated sees the 
practice of Mumbo-jumbo. Mumbo-jumbo, as 
I use the term, is the transference of devotion 
from a set of principles to the symbols and ritu- 
als that are built around them. It’s the busi- 
ness of taking over a good sound idea, building 
an elaborate shell around it, then carefully ra 
moving the already wilting idea and beating 
its brains out with the shell. Mumbo-jumbo 
creeps up in practically every field of endeavor. 
It gets into the arts . . . into medicine when 
the operation becomes more important than the 
patients” [2, pp. 41-42]. ahe 
Granted that we lose the patient in t ? 
Process of studying him, why should this be 
Partially, it is because we have failed to se 
the patient as he lives from day to day. In out 
assessment of people, we are seemingly at a Joss 
in predicting such elementary things as how 
the person gets along with other persons: 
whether a patient is liked or disliked by other 
patients, what sorts of people he likes or dis- 
likes, who the leader of a psychiatric wat 
might be, how the patient would get along 
with certain authority figures, etc., etc. i 
not unreasonable to propose that validation 
studies should concern themselves with su 
problems. The writer concludes, a priori, E 
there is nothing wrong with psychologist 
spending time observing the behavior of people 
As an example, one can see much merit in the 
approach of Barker and: co-workers [1]. Th® 
time-worn story about a natient’s remark to 7 
psychiatrist still holds. “What do you enou 
about a patient? You only see him once, t : 
nurses and attendants are here only eight hou” 
a day, but me, I’m here a full 24 hours a day; 
What do you want to know about so and ah 
Increased knowledge of the ins and outs it 
a patient’s life should lead us to try and i 
our studies in a more practical mold. Not °” i 
that, but it might lead us to use our diagnost! 
instruments as a means of assessing the person 
as he lives from day to day rather than desc"! 
ing him by means of a series of generalize 
statements which are 
sounding, but not very meaningful. 4 
In closing, the writer would like to re-e™ 
Phasize his feeling that diagnostic testing 
should further our understanding of persona 
ity structure and add to our limited knowledg®? 


impressive and high- 
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' of psychopathology. If we glance back at what 


ee much has been couched nega- 
eae = i er as it were, has its justi- 
e a a oe that we are not pressing 
al a solution of major problems in clini- 
Bek Se sg goia, could be aided by diag- 
Danes we ng. Our literature is swollen with 
clinical i the administration of good 
A A Ta validation or invalidation of 
oe R ts, and innumerable brochures and 
6 Res rh eg of this or that test. 
lems Sio bs fw Seine any long-term prob- 
planning ee T 3 mae tl administrative 
ew tests swith nj hrooming development of 
lems lend Ries 3 : the standardization prob- 
s it an idle to k certain frenetic quality. 
irection of lo at we will move in the 
g-term studies which seek to 
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answer certain basic problems. 


Received February 22, 1954. 


References 


1. Barker, R. G., & Wright, H. F. One boy’s day, 
New York: Harper, 1951. 

2. Block, H. The Herblock book. Boston: Beacon, 
1952, 

3. Gurvitz, M. S. The dynamics of psychological 
testing. New York: Grune & Stratton, 1951. 

4. Patterson, C. H. The Wechsler-Bellevue scales, 
a guide for counselors. Springfield, Ill.: Charles 
C. Thomas, 1953. 

5. Shneidman, E. S., Bell, J. E., Fine, R., Holt, R. 
R., Kutash, S. B., & Vorhaus, Pauline G. The 
case of Jay: interpretations and discussion. J. 
proj. Tech., 1952, 16, 444-475. 

6. Wittenborn, J. R. Statistical tests of certain 
Rorschach assumptions: analyses of discrete re- 
sponses. J. consult. Psychol., 1949, 13, 257-267. 


R» 


Jorga of Consulting Psychology 
ol. 18, No. 5, 1954 


Acceptance and Acceptability: An Examination of 


Social Reciprocity” * 
Seymour L. Zelen 


State University of Iowa 


One hundred and forty-five sixth-grade chil- 
dren in five classes were given the Bonney So- 
ciometric, the Feelings of Personal Worth 
Subscale of the California Test of Personality, 
and the W-A-Y technique. The latter two in- 
struments yielded scores of self-acceptance, 
while the sociometric gave scores of peer status 
and acceptance of peers. 

Peer acceptance correlated .59 with accept- 
ance of others, significant at the .01 level, and 
30 and .39 with the self-acceptance scores of 
the W-A-Y and the CTP Feelings of Person- 
al Worth Scale respectively, both significant 

jat the .01 level, Acceptance of others corre- 
“lated .08 with the W-A-Y and .10 with the 
Personal Worth Scale; neithe 


r of these proved 
significant. 


The expected positive correlations of peer 
acceptance with acceptance of others and ac- 
ceptance of self were obtained. This suggests 
that liking others and being liked by others are 
reciprocal characteristics. Individuals with high 
group status tend to find many group members 


JAn extended Teport of this study may be ob- 
tained without charge from Seymour L. Zelen, Child 
Welfare Research Station, University of Towa, Iowa 
City, lowa, or for a fee from the American Docu- 
mentation Institute. To obtain it from the latter 
Source, order Document No, 4307 from ADI Auxil- 
lary Publications Project, Photoduplication Service, 
Library of Congress, Washington 25, D. C., remit- 
ting in advance $1.25 for microfilm or $1.25 for 
photocopies, Make checks payable to Chief, Photo- 
duplicat'en Seryjce, Library of Congress, 
~?This research was supported by Research Grant 
MH-301 from the National Institute of M 
Health, of the Nation 


1 Institut fH wal 
at dnstitutes of Health, U, i 
Public Health Service. sae ES 


highly acceptable. Self-perception and etn 
tion by one’s peers also produced a E 
relationship. These findings suggest that a g5 a 
who has positive feelings about himself is 
ter able to devote his energies to the group = 
tivities and to cooperate more fully with anaa 
The child with negative self-percepts may 
constantly on guard against new perceive 
threats from others. 


The lack of any relationship between “ 
measures of self-acceptance and acceptance © 
others was unexpected. An interpretation 18 
offered in terms ot the discriminability of in- 
terpersonal or social cues, 


It is possible that children might be aware 
of and capable of discriminating cues of a 
ternal behavior, but would not be aware of t 
cues upon which the more subtle social rels 
tionships are based. 
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areen ~ there has been a sharp in- 
RENAE ‘sh pre of experimental studies 
n particular z va idity of the Rorschach test. 
Peared dealin, s wii of investigations has ap- 
color, In en with the nature of reactions to 
and Hertz [9] poe these studies, Benton [2] 
indings ith i poige out the generally negative 
emphasize denn to the effects of color and 
earlier Rorsch oa for considerable revision of 
are limited oa theory. Most of these studies 
tlon of only hat they dealt with the valida- 
i ¥ one or two Rorsthach scores or con- 


Sidere 

d only o 

: ne ees case i 

Variables € of many pertinent independent 


cre; 
cor 


ie research was designed to in- 
ects ci i 
cts of anxiety, color, stimulus 
; order 

» Considered sit 


a 


of presentation, and ex- 
atge i agly and in combination, 
umber of Rorschach variables. 


Description of the Study 
The Minnesota 
co (MMP 
sone ne in 

Są he U 


Sheet 
S Were 5 
est Scored f 


a Multiphasic Personality 
I) was administered to 696 
various dormitories and so- 


or both the Taylor Mani- 
[17] and the Winne Scale 
0]. High- and low-anxiety 
tablished by selecting women 
eÈ 15 pep ine aylor scores in the upper or low- 
or lower 25 oe Winne scores in the upper 
ies sh of the respective distribu- 
nphasis was pl d J= 

than Wing i p acec upon Tay 

ity and its 1 es ecause of its higher re- 
more exténsive use in previous 

es of anxiety [10]. One hun- 
ght Women, 64 from each cri- 


University of Texas. 


est, 


F ei 
Formerly at The 
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terion group, served as subjects in the experi- 
ment. 


Achromatic copies of Rorschach Cards II, 
III, VIII, and IX were carefully prepared by a 
special photographic process to insure faithful 
reproduction of the inkblots. These particular 
cards were chosen for the following reasons. 
First, Cards 1I and lI represent one kind of 
color application while cards VHI and IX rep- 
resent another. The former have but a single 
color, bright red, while the latter have a varie- 
ty of colors blending together. It is quite possi- 5 
ble that one type of color would have a differ- 
ent effect than the other. Second, Cards IH and 
III are only partly colored and partly black 
and white, whereas Cards VIII and IX are 
completely colored. The advantages of using 
these two pairs of cards rather than any others 
will become apparent when the experimental 
design has been discussed. 

Since it was desirable to study simultane- 
ously a number of independent variables in 
order to isolate interactions as well as main ef- 
fects, a rather elaborate experimental design 
was employed. Thirty-two basic plans were 
constructed in which stimulus configuration or 
inkblot, color, and order of presentation were 
varied systematically in a completely balanced 
fashion. One half of the subjects received a 
colored card on the first trial, the other half 
getting an achromatic card first. Similarly, each 
stimulus configuration appeared equally often 
on each trial. A standard procedure with full 
inquiry, according to Klopfer and Kelley [11], 
was used; each individual was administered all 
four inkblots, two in the original Rorschach 
version and two in the achromatic form. 

The number of possible permutations or 
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orders of presentation of the four inkblots, ig- 
noring the presence or absence of color, is 24. 
This was reduced to eight by pairing Card II 
with Card III and Card VIII with Card IX. 
Thus, both members of a given pair always ap- 
peared together in either the first or last two 
trials. When the color variable (chromatic vs. 
achromatic) was superimposed on stimulus 
configuration, a total of 32 plans was required 
to balance the design completely. 


With 128 subjects, four replications of the 
basic design were possible. Two additional in- 
dependent variables, Examiner X vs. Examiner 
Y, and high-anxiety group vs. low-anxiety 
group, used up the replications. Since much of 
the confusion in the Rorschach literature may 
be a function of examiner variance, two ex- 
aminers were used, one with considerable ex- 
perience in administering and interpreting the 
Rorschach and the other with formal training 
on the Rorschach but little clinical experience. 
Subjects within each anxiety group were assign- 
ed at random to examiner and plan by a third 
person, the only individual who knew whether a 

gpaticular subject belonged to the high- 
anxiety group. This was necessary to avoid the 
Possibility that the examiner’s administration of 


the cards might be influenced by knowledge of 
the subject’s classification. 


Every Rorschach res 


or low- 


l ponse was scored for 
location, form level, movement, shading, and 


content. Because of the subjectivity necessarily 
involved in scoring form level, each response 
was scored twice according to Beck’s tables for 
F+% [1] by two psychologists working inde- 
pendently. The interscorer reliability for F 
+ % was .83, The actual scoring reliability 


ert remarks by the sub- 


r for each card. In addi- 
y pfutocol was scored according to 


igns of anxiety [8], a list of signs 
based on content analysis. 


Results 


Since all possible advance clues to the sub- 
ject’s classification were withheld from the ex- 
aminers, the more experienced of the two ex- 
aminers (X) judged each of his 64 subjects as 
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“anxious” or “nonanxious” solely on the basis 
of behavior during the individual testing ses- 
sion. No judgments were made by the other ex- 
aminer since he did not feel sufficiently compe- 
tent to attempt this task. A number of signs 
were employed by X in making a judgment: the 
degree of composure shown by the subject upon 
entering the room, questions regarding the pur- 
pose of the test, the subject’s attitude toward X, 
his readiness to cooperate, and his | atten- 
tiveness to directions. After administering 
the test, if X still felt that he needed more in- 
formation before making a final judgment, he 
conducted a short interview in which atitin 
toward the university, school grades, socia 
activities, and plans after graduation were dis- 
cussed. The basis of judgment could best be 
described as intuitive and global, consisting Pt 
marily of behavioral signs other than specific 
responses to the test materials. A comparison of 
the judgments made by X with the actual cri- 
terion grouping is presented in Table 1. That 
he was able to detect the high- and low-anxiety 
groups with such a high degree of accuracy at- 
tests to the validity of the anxiety criterion. 


Table 1 
Success of Examiner X in Judging Anxiety Solely 
on the Basis of Subject’s Behavior during the 
Testing Period 


Examiner's Grouping based on Taylor’s scale 

judgment High anxiety Low anxiety Total 
High 26 9 35 
Low 6 23 29 
Total 32 32 g & 


x?= 16.14 (p < .001). 


Three general levels of analysis Wee 
made: one based upon response to the first ca” 
only in the series of four cards presented a 
each subject; one dealing with only the firs 
two cards in the series; and one concerned wit! 
data such as total number of responses an 
F + % arising from all four cards. 


` When only the first card is considered; 
four of the primary variables—examiner, anxie- 
ty, color, and Card II vs. Card III—can be ar- 
ranged in a 24 factorial design with four repli- 
cations to provide an adequate error term. 
similar design exists for Cards VIII and IX. 


Number of 


Rorschach Color Responses and Manifest Anxiety 


Ignoring the differences cited earlier between 

these two pairs of cards would allow combina- 

tion of both designs with double the number of 

os for evaluating ‘the efiects of examiner, 
xlety, color and their interactions. 


ne pei variables or test scores that 
cdot the Anp according to this design consist- 
rom initial ies ing? (a) reaction time, the time 

response: T ain of the card until the first 
es number of responses; (c) num- 

P+ % hey f using the whole inkblot; (d) 
only; H a xa level of the first response 
kind of | Rene er of responses having some 
ment as a determinant; and (g) 

minant. responses with shading as a deter- 
so kindi of statistical procedure 
test scores more o the study. When the 
or could be E gue continuous and normal 

'stribution) adi y transformed into a normal 

Were e variance methods 
+ At the first level of analysis 


Ty 
Were 


thi 
time, When tt be the case, only for reaction 
the test scores were categorical in 


€d, the distrib ely discrete and severely skew- 
the median utions were dichotomized near 
Fisher’ and handled by chi square or 


CTS exact meth 


Nificang, 
e of 
ages, the 


The Se 


Ist two 


di od [6] for testing the sig- 
ifference between two percent- 


A ri g analysis dealt with the 
e F er rather than Trial 1 a- 
Combined with or a two-by-two latin square 
an analysis a a factorial design made possible 
the eine e effect of order of presenta 
AChromarichar., (colored-before-achromatic vs. 
cllects .°re-colored) as well as practice 
K ge and the interactions of 

Cy SParately f d rial, and order. This was 
ards ~ or Cards II and III and for 
rn es Differences among the 
t© sonia, n were completely lost 
for nding. This design was em- 
Since the othe, CPêlysis of reaction time only 
Skewed, €T variables were too discrete and 


Wis 
Ployeq 


AR Cae 
With e third level o 


ata . 
ance o, obtained 


iety 


f analysis was concerned 
ties from the subject's perfor- 
and Sa cards. In this case only anx- 

ner could be studied as indepen- 
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dent variables, using a two-by-two factorial de- 
sign. The test data comprising dependent vari- 
ables consisted of the following: (a) mean re- 
action time to all four cards; (4) difference 
between mean reaction time to the colored 
cards and that to the achromatic ones; (c) total 
number of responses; (d) total F + 9%; (e) 
number of cards on which the first response had 
a poor form level; (f) difference between 
F + % for the colored cards and F + % for 
the achromatic ones; (g) number of whole re- 
sponses; (4) movement; (7) shading; (7) Sum 
C scores; (4) Elizur’s anxiety score; (/) an- 
imal content (4 + Ad); (m) human content 
(H + Hd); (n) rejected cards; and (o) 
spontaneous, immediate remarks concerning the 
color. The first four of these scores were han- 
dled by analysis of variance while the remainder 
were analyzed using chi square and related pro- 
cedures. 


Reaction time. Much has been said in Ror- 
schach literature concerning the psychological 
meaning of reaction time. A significant increase 
in reaction time to colored cards is generally o 
considered an indication of “color shock” [11,8 
14]. Emotionally disturbed individuals will 
presumably have a long reaction time or show 
other disturbances due to colors, especially on 
Cards II and III. From this we might expect 
that, in general, mean reaction times for the 
colored cards would be longer than those for 
the achromatic versions. Moreover, there should 
be a significant interaction between color and 
anxiety with respect to reaction time if the 
above theory is correct. 


A more comprehensive analysis was made of 
reaction time than of any other variable, mainly 
because of the continuous nature of reaction 
time scores, which permits the use of analysis of 
variance. Since the original scores were skewed 
inthe typical fashion of reaction time data, an 
inverse square root transformetion Was em- 
ployed to normalize the score distributions prios 
to analysis. An analysis of variance of the trans- 
formed reaction time scores for Trial 1 only 
and for Rorschach Cards II and III is pre- 
sented in Table 2. 


In this analysis, all insignificant, higher order 
interactions were pooled with the within sum 
of squares to provide ən error term with 57 
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Table 2 


Analysis of Variance of Transformed Reaction 
Time Scores for Rorschach Cards II and III, 
First Trial Only 


Source of Mean 

variation square df F # 
Examiner 220.9 1 163 — 
Anxiety 11.4 1 08 — 
Inkblot 38 1 01 — 
Color 876.2 1 6.50 .02 
Examiner by color ` 581.1 1 4.31 .05 
Examiner by anxiety by 1095.5 J a 30 

inkblot 

Pooled residual 134.8 57 


df. Only one of the main effects was significant. 
Reaction time to the colored cards was signifi- 
cantly faster than response to the achromatic 
cards. Although this was more the case for Ex- 
aminer Y than for Examiner X, as evidenced by 
the significant examiner-color interaction, these 
results suggest, contrary to the opinion of many 
clinicians, that bright red color, as applied on 
, Cards II and III, evokes an earlier response 
¢Fthan if these cards were achromatic. 


The critical source of variance from the 
point of view of Rorschach theory, the inter- 
action between anxiety and color, was negli- 
gible. Both “anxious” and “nonanxious” wo- 
men responded in an identical manner. The 
hypothesis that differences in reaction time to 
colored and achromatic inkblots are related to 
anxiety has not been substantiated by analysis 
of response to the first card only. 

, The interpretation of the si 
interaction, examiner- 
Assuming that this i 


gnificant triple 
anxiety-card, is unclear. 


s a nonchance result, it 
probably reflects examiner differences more than 


anything else and would Prove theoretically 
Important only if one or more of the lower 


order effects involving these three variables had 
also beex signicant. 


The same analysis of Cards VIII and IX re- 
vealed no significant factors related to reaction 
time. Unlike Cards I and III, reaction time 
to these cards is the same in both the multicolor- 
ed, standard form and in the achromatic exper- 
imental version. These results are consistent 
with the findings of Dubrovner et al. [5], who 
found no differences in, reactivity that could be 
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attributed to color. The present study a 
however, that the bright red color may stl 
late the subject to respond more quickly. 


On the other hand, Siipola [16] caged 
just the opposite for a number of colored eo 
of the Rorschach inkblots. Using matched = 
ed and achromatic versions of smaller inkb an 
obtained by cutting out the usual detail pen 
of Cards II, III, VIII, IX, and X, she one 
consistently longer mean reaction tme 
college women when color was present = 
when it was absent. Additional oppenen A 
tion, with color and inkblot varied systema E 
ally in an extensive factorial design, is necessa 
to resolve these apparent contradictions. 


Table 3 contains the results for reaction i 
on Cards II and III when the first two cig ia 
presented to the subject are considered el 
taneously. Only one source of variation, the it 
der of presentation of color, proved signita j 
The colored-before-achromatic order yie i an 
a significantly faster reaction time bt . 
the reverse order of presentation. Again it ie 
pears that the bright red colors are a 
to the subject, this time shortening the laten 
of his response to the card which follows. 1l 

At the third level of analysis, employing Pa 
four cards, two scores were derived from e 
reaction time data: (a) mean reaction Bee 
and (b) difference between mean reaction ae 
to the colored cards and mean reaction time r- 
the achromatic cards. The latter was of m1] 
ticular interest since previous writers [2 ee 
on color shock have stated that a delay in "4 


Table 3 . Time 
Analysis of Variance of Transformed Rea 
Scores for Rorschach Cards II and III, 
First Two Trials 


Source of Mean pr? 

variation square df 
Independent observations 
Anxiety 0 1 0.00 o1 
Order of color 2080 1 OE 
Order by anxiety 488 1 1.66 
Residual bet,veen subjects 294 60 
Correlated observations 
Trial 7 1 0410 
Color 66 1 096 
Trial by anxiety 6 1 0.09 
Color by anxiety s 149 1 2416 
Residual within subjects 69 60 


al 


- VUI 
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tion time to a colored card is one sign of 
shock” that presumably occurs with greater 
frequency in neurotic or anxious individuals 
than in others. An analysis of variance was 
P = variable, breaking down the total 
1 nto components attributable to ex- 
T al and examiner-anxiety interac- 
io fe : having 1 df, and an error term with 
df. In neither case did either of the main 


effects or their i : 
‘ aeir interactior f ignifi- 
cance, 1 approach signifi: 


te of these three different sets of 
time is a cme the extent to which reaction 
color, and af ton of examiner, anxiety, inkblot, 
ized as foll neir interactions can be summar- 
many psyct res Contrary to the opinion of 
support the ogists, there is little evidence to 
matic inkblot © of a long reaction time to a chro- 
there is lite as a sign of color shock. Likewise, 
anxious oe AC aa for the contention that 
Colored fice uals take longer to respond to 
whereas tid $ black and white inkblots, 
thing, the b 5 at subjects do not. If any- 
apparent] right red color oh Cards II and III 
spond oe most individuals to re- 
Carry over to > This stimulation may 
Quicker respon: a card, as illustrated by a 
Tst inkblot y se to thé second card when the 
color. Throushe, partly covered by bright red 
aà consistent na the analysis of reaction time 

ards II and Wren was found between 
oTa p cy ube chen a d ake a 
Ome interestin other. This finding raises 
Concerning th s questions for further research 
tion time of i G comparative effects upon reac- 
mode of appl Saato in hue, configuration, and 

Plying the color to the inkblot. 


Num 

o e i responses. Although the number 
One to sti ven to the first card ranged from 
two Tesne most women gave only one or 
ness and 5 oto card. Because of the discrete- 
tst card ean of the data whea only the 
TeSOrt to less a ag it was necessary to 
OF variance to de icient methods than analysis 
independent etermine the role played by each 
Was ehoro a Ple: The distribution of scores 
Old tables y 'zed close tothe median, and four- 
Variable ee Constructed ; one independent 
Ignored, This sidered ata time and the others 
and III ler was done separately for Cards II 
or Cards VIII and LX as well as 


for all four inkblots combined. The only vari- 
able which showed a significant relationship to 
number of responses on the first card was color 
for Cards II and III. Inspection of Table 4 re- 
veals that significantly more women gave more 
than one response to the colored cards than to 
the achromatic ones. Apparently the bright red 
colors on Cards II and III stimulate the indivi- 
dual to greater productivity and also to respond 
more quickly than otherwise. 


Table + 


Number of Responses to the First Card as a 
Function of Color, Rorschach Cards II and IIT 


Number of Color of inkblot 
responses Chromatic Achromatic Total 
2 or more 22 13 35 
1 or less 10 19 29 
Total 32 32 64 


x2 = 4.04 (p = .05). 


When the total number of responses for all 
four cards was considered, the frequency dis- 9 
tribution was only moderately skewed. An an-& 
alysis of variance using a two-by-two factorial 
design revealed no differences among examiners 
or high- and low-anxiety groups. 


These negative results are contrary to those 
obtained by Eichler [7] and by Westrope [18]. 
Eichler reported a significant decrease in the 
number of responses given by individuals under 
stress conditions. However, in a study relating 
Rorschach variables to Taylor’s anxiety scale, 
Westrope found just the opposite. Significantly 
more responses were given by her high-anxiety 
group than by the low-anxiety group. 


The interaction between examiner and anx- 
iety was also negligible. Since the distribution 
of scores was moderately skewed, an additional 
test was made by dichotomizing the distribu- 
tion at the median (nine responses) and con- 
structing fourfold tables for each independent 
variable. Again, no differences between groups 
were revealed. The results obtained in this ex- 
periment suggest that there is little relationship 
between the number of responses and manifest 
anxiety as measured by the MMPI. Although 
previous experimenters [4, 5, 13, 15] have con- 
cluded that color does net increase productivity, 
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the present findings indicate that the bright red 
hue on Cards II and III may result in a great- 
er number of responses. 


Form level. Each response was scored either 
“plus” or “minus,” using Beck’s tables [1] asa 
guide. When only responses to the first card 
were considered, it was discovered that no wo- 
men gave minus responses to Card III, only 2 
gave one or more minus responses to Card VIII, 
4 to Card II, and 16 to Card IX. Since a bal- 
anced design had been used by which each card 
would be presented first to 32 different women, 
it is quite clear that Card IX is more likely to 
yield a minus response than any of the other 
inkblots used in this study. This is compatible 
with the often reported fact that Card IX has 
the longest reaction time and is the most fre- 
quently rejected card. 

Using presence of one or more minus respon- 
ses to the first card vs. no minus responses as 
one variable and one of the independent vari- 
ables (examiner, anxiety, inkblot, color) as the 
other, fourfold tables were constructed and 

_ tested for significance. With the exception of 
ithe differences already noted from one inkblot 
to the next, none of the relationships even ap- 
Proached statistical significance, Similar results 
were obtained when F + % for the first card 
was analyzed. 

Consideration of total F + % based upon 
all four cards yielded different results. A sum- 
mary of the analysis of variance for the two- 
by-two factorial design is presented in Table 


. There was no appreciable difference in the 
mean F + % 


groups. This is 
sults reported by Westrope (18), who also 


ety scale, 


for F + % on the colored cards 
alone as 


However, 


Portance of examiner differences, 
theoretical Consequence since the e 
lety interaction is negligible. 


Two other variables dealing with form ley- 
el were studied, the number of cards on which 
the first response had poor form level and the 
difference between F + % on the colored and 


are of little 
xaminer-anx- 
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Table 5 
Analysis of Variance for Total F + % 
Source of Mean 
variation square df E = 
Examiner 1378 1 me cu 
Anxiety 43 1 ros a 
Examiner by anxiety 8 1 I 
Residual 247 124 
A icular 
achromatic cards. The latter was of Ponal 
interest because of the investigation by level 


liams [19] suggesting that drop in m a 
on colored cards is a sign of poor contro sable 
may also be related to anxiety. Neither bie in 
proved related to either examiner or ae us 
the present study. Fifty-five per cent © jety 
women in both the high- and lon amia 
groups gave all four first responses with ee 
form level. Both groups also showed the a on 
form level on the colored cards as they di j 
the achromatic versions. Contrary to the fin d 
ings of Lazarus [12], there is no evidence E 
support the hypothesis that a drop in for 
level generally occurs in moving from @ blac 
and white inkblot to a colored one. 

Other Rorschach variables. None of the id 
maining variables was sufficiently continuous A 
nature to permit the use of analysis of E, 
ance. Consequently, it was necessary to re 
to categorical treatment, using for the, mo i 
part fourfold tables to investigate the gat 
cance of the major factors under considerati? Š 

The number of responses using the W 4 
inkblot, the number employing movement ing 
determinant, and the number using sha z 
were analyzed for the first card only as pr 
as for the summary data based on all jety 
cards. In addition, Sum C, Elizur’s a 
score, animal and human content, rejer i 
cards, and occurrence of spontaneous, imme ti- 
ate remarks to the color were carefully inves rs 
gated for any differences between examine 
or between the high- and low-anxiety group™ 
Aside from minor differences between ar 
iners in the number of movement responses; 
Significant factors were discovered for any ° 
the remaining variables, f 

The negative results for Elizur’s anxiety 
Score are of special interest because of its 1° 
Ported validity as a measure of anxiety [8, 18J- 

he mean score for the high-anxiety groUP 
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was 1.26, while that for the low-anxiety group 
was 1.15, a negligible difference. 


One explanation for the lack of significant 
ee o Elizur’s anxiety score, as well as for 
E pa o Rorschach variables, is that 
Ea i 3 four cards, instead of the 
ee] cat ten cards, results in scores of 
mite S Reducing the number of cards 
Te mia 3 to each subject may have lowered 

beni sty, a of Rorschach scores in the pres- 
nibs ace wt n the other hand, the number of 
e i ae is sufficiently large that a 
cally se a should prove statisti- 
atin is a za ; though lack of such a relation- 
Hinetitnce inden en does not prove its 
cerning “i it does raise serious questions con- 
iach ace „uncritical adoption of the Ror- 
re in question for use in the clinic. 


Summary and Conclusions 


Thi ; 
the pe nr enn was designed to investigate 
Configuration Ups of anxiety, color, stimulus 
aminer with Api of presentation, and ex- 
Variables, Hi ieee of different Rorschach 
taining 64 ee n- and low-anxiety groups con- 
College ie ay each were selected from 696 
aylor’s Manife the basis of MMPI scores for 
cale of Neu a Anxiety Scale and Winne’s 
Orschach eens Achromatic copies of 
Carefully coepared I, III, VIII, and IX were 
responding sta i and used together with cor- 
> Colored and ty ndard cards. Four inkblots, two 
_ Order and balay achromatic in a predetermined 
. a standard ais design, were administered 
two examine ashion to each subject by one of 
two exami N The more experienced of the 
lous” op « Bee Judged each subject as “anx- 
level of inten at better than the .001 
avior durin pt iy solely on the basis of be- 
1S provide e individual testing session; 
Criterion, a check on the adequacy of the 


The à 

E ae and conclusions were as follows: 
Yieldeq nE a versions of Cards II and III 
Significant y s antly shorter reaction times and 

atic Weise at responses than did the achro- 
Vers no diffe. of these same inkblots. How- 
tained for ht ascribable to color were ob- 
and a same variables on Cards VIII 
red color of ending suggests that the bright 
ards II and III is more stimu- 
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lating than the multicolored pastel shades of 
Cards VIII and IX. The shorter reaction 
times to the colored versions of Cards II and 
III are contrary to expectations from color 
shock theory. 


2. The colored-before-achromatic order of 
presentation resulted in a significantly shorter 
mean reaction time for Cards II and II than 
did the reverse order, achromatic before col- 
ored. This is consistent with the hypothesis that 
the bright red colors of Cards II and III 
stimulate the individual to respond more 
quickly. 

3. Women tested by Examiner Y gave a 
significantly greater percentage of responses 
with poor form level than did women tested 
by Examiner X, indicating the importance of 
controlling the examiner as a variable in re- 
search of this type. 

4. Contrary to the expectations of earlier 
Rorschach theory, none of the remaining Ror- 
schach variables proved significantly related to 
anxiety, color, or order of presentation. 

It is clear from the present research that 
many conceptions of how color, examiner, PET ey 
sonality, and order-of-presentation variables af- 
fect performance on the Rorschach test will 
have to be revised considerably. Further studies 
similar to this one, which compare several fac- 
tors simultaneously by use of modern experi- 
mental design, are needed to resolve apparent 
contradictions in the literature. 


Received January 8, 1954. 
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the behavioral situations to include measures 
of fantasy as well as motor activity. The spe- 
cific hypotheses are: 


1. Schizophrenic Ss assigned to a High-M 
group on the basis of their Rorschach records 
differ significantly from Low-M Ss on a series 
of tasks measuring motor activity and fantasy 
behavior or introspectiveness. High-M Ss show 
greater delaying capacity, less impulsivity, less 
spontaneous motor response, and higher scores 
on measures of fantasy. A subhypothesis in this 
connection was derived from an earlier study © 
[15] in which it was found that waiting-room’ 
activity scores varied not only with M but with 
the relationship of M and the weighted color 
responses (Sum C). This finding offered strik- 
ing support to Rorschach’s juxtaposition of 
these two types of response determinants (M: 
Sum C) as an index of relative weight of in- 
troversive or extratensive response tendencies. 
It was hypothesized, therefore, that, at least 
in the case of spontaneous motor activity (wait- 
ing-room behavior), the degree of activity 
varies with the increasing weight of color in 
the experience balance of the patients. 


2. If Rorschach descriptions of the interre- 
lations of motor and fantasy activity are cor- 
rect, one may anticipate a certain consistency 
im Ss’ performance from one situation to the 
next. Individuals with relatively num-rous M 
also manifest greater motor inhibition, less 
spontaneous motor activity, and more fantasy. 
Specifically, the subtests that tap various as- 
pects of the motor inhibition — motion percep- 
tion—-fantasy dimension are intercorrelated and 
define a common factor or meet some appropri- 
ate standard of interrelatedness. These corre- 
lations may not be high because of the numer- 
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ous situational, uncontrolled factors that un- 
doubtedly limit the reliability of a Rorschach 
examination. Some gross consistency of per- 
formance is certainly to be expected, however, 
if Rorschach’s formulation has any validity. 
When Rorschach factors are used in relative 
isolation in this investigation with little con- 
cern for “configurational” features, any signifi- 
Cant correlations between M and behavioral 
situations should be all the more striking as 


evidence of the essential meaning of the human 
movement determinant. 


Subjects 


In order to repeat some of the conditions of 
the previous study [15], a new sample of 60 
male schizophrenic veterans was employed. 


clinically administe red Ror- 


Ps were larger 
Most of this dif- 
to differences in 


the High-M Ss 


than in the Previous study, 
ference could be attributed 


as somewhat dif- 
two groups, although Not signifi- 
cantly go, Thus FC responses tended to cor- 
relate Somewhat better with 3f and R than 
with the other color determinants. 


» degree of 
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e “dilated” €xPerierice- 

igh Sum CG Proved 
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i ; he ` 
“interesting,” albeit no less disturbed than t 
other subgroups. 


Procedure 


Each S participated in five erperimen 
situations in more or less the same order. A 
casional changes in sequence were ge 
when patients became disturbed or — 
wandering attention. In all cases the oana 
(always one of the authors) was aafaa 
with patients’ Rorschach scores to minim 
any unconscious influence on performance. 


1. Waiting-room activity ratings. ee | 
cedure, modified from a method de ina 
Rickers-Ovsiankina [10], was describe d in- 
previous paper [15]. The § was cond 
to a waiting room and informed that Æ ae h 
call for him shortly. He was seated E 
table on which were placed a variety of 7 , 
and games. The § was then observed can 
minutes by means of a one-way vision ded at 
All activity and movements were recor ae b 
30-second intervals. These protocols were ate 
sequently rated by, judges on a six-point i E 
for degree of activity and environmenta use | 
sponsiveness. The scale itself was sm ibility | 
and had reasonably high interrater re a for 
[15]. A patient who sat quite still ar ee a 
an occasional shifting of weight or pu while 
cigarette would obtain in minimal score, V ma- 
an active individual who paced the me and 
nipulated many of the objects on the tab cor x 
spoke aloud would obtain a maximum 2 ple : 

2. Motor inhibition task. This was a oe e 
test modified from Downey’s Wile Tet 
ment Scale and employed in previous inv’ 2 
gations of this series [7, 15]. The § nee 
quired to write the phrase “New Jersey Ch? 
ber of Commerce” as slowly as he poss! he 

oe tl 
could without stopping motion or lifting a 
pencil from the page. A sample of ye 
normal tempo was obtained prior to the ari 
mental trial to evaluate the extent of S’s € jon 
to comply with the instructions, This pe 
was necessary because of the fairly onu 
pat:ent groun employed. The data here wa y 
the times in seconds taken to write the ee 
3. Thematic A pperception Test. Cards LA | 
& 6BM, and 7BM of the TAT were admi | 
istered under two conditions. Initially each s 
Was asked to describe each card. After co™ 
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pletion of the five descriptions, the cards were 
Presented again with the usual instructions to 
make up a story. The protocols were scored by 
means of a modification of Weisskopf’s tran- 
Scendence index [17], a measure of the extent 
to which content is introduced into $’s story 
oes goes beyond the actual material inherent 
k the stimulus. Additional characters, emo- 
tn lesan to characters, mention of past 
eon shail were all scored as transcendent 
pole arte to a system of thought units. 
orden te me or each series was obtained. In 
a et ene a measure of voluntary fantasy 
iF the icone e transcendence scores 
employed. While n an _ Story conditions was 
other investigators have em- 

lobal ratings of over-all creativ- 
[13, 16], it was felt here that 
index would be 


eee 
it, by AE a as, Goldstein might put 
lrectly called £ ee and persons not 
Verbal uenc torth by the card itself. Actual 
Y 1S not sufficient here, although 
ation to the task. Thus, a 
sent a lengthy, obsessive de- 
ard and of the specific clothes 
e characters yet never obtain a 
transcendence. A story like: 
ii hell P him and his teacher en- 
Practice hard day by day 

an evening 20 years from now 
H te efore a Carnegie Hall audi- 
Shore, has a rel other hand, while relatively 
` Cancel e high transcendence score. 
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and time, since the task makes little intellectual 
demand on Ss. This test was included chiefly 
in an exploratory attempt to observe whether 
Ss with low M and high Sum C would show 
many errors. Perhaps more complex situations 
might have been more discriminating, but pre- 
liminary research with similar patients re- 
vealed that such tasks made considerable de- 
mands on the limited attention of schizo- 
phrenics. 


5. Guilford’s Thinking Introversion Scale 
(Factor T of the Inventory of Factors S T D 
CR). The items on this scale are described by 
Guilford as defining a factor which involves 
“an inclination to meditative or reflective 
thinking, philosophizing, analysis of one’s self 
and others, versus an extrovertive orientation” 
[5, p. 000]. Certainly this description re- 
sembles some of the propensities of High-M 
individuals as described in the Rorschach liter- 
ature. While the inventory was developed with 
college students and has some of the usual limi- 
tations of questionnaires, it was included here 
in an exploratory way to obtain some measure , 
of the patient’s self-perception as a thinking int 
trovert. In the interests of maintaining a 
reasonable time limit and feasible battery of 
tests for this schizophrenic group, only the T 
scale of the inventory was employed. To facili- 
tate administration to this group, items were 
printed on cards and sorted in the manner of 
the MMPI. It must be recognized that these 
deviations from the standardized mode of ad- 
ministration may well alter the test and in- 
crease uncontrolled variability. 


Results 

Table 1 presents pertinent background in- 
formation, Rorschach scores, and results on the 
experimental situations for the High- and 
Low-M groups. Inspection of this table re- 
veals that the general trend of the data is in 
the hypothesized direction. Hich-f Ss differ 
from the Low-M patients by manifesting lorg- 
er inhibition times in the writing task, less 
spontaneous activity in the waiting room, great- 
er transcendence of stimulus content in the five 
TAT cards, fewer errors in the cancellation 
task,* and greater tendency toward thinking 

8 The groups did not differ significantly in speed 


of performance although Low-Zf Ss tended to work 
a little more rapidly, 
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introversion on the Guilford scale. Analysis of 
variance for the motor inhibition times reveals 
an F ratio of 9.6, significant beyond the .01 
level, with the group differences also signifi- 
cant by the ¢ test beyond .01. Waiting-room 
scores also yielded an F ratio of 5.19, signifi- 
cant beyond the .01 level, with the group means 
differing sigaificantly by the ¢ test at the .01 
level. Scores on the transcendence index yielded 
an F ratio of 5.96, significant at the -01 level, 
and again a ¢ test yielded significance beyond 
-01 for the difference in group means. Neither 
the cancellation errors nor the Guilford scores 
yielded significant ¢ or F values although trends 
were evident. Results of these tests, therefore, 


tend on the whole to Support the initial hy- 
pothesis, 


Table 1 


Means for High- and Low-M Groups on 
Pertinent Background Data, Rorschach Variables, 
and Experimental Situations 


Groups 
Matching variables High-M group Low-M group 


A (N=28) (N =32) 
~ Background variables 


Age 


29.6 31.4 
Education (years) 11.7 11.2 
IQ (Wechsler-Bellevue) 111.5 108.2 
Rorschach Variables 
M 2.6 0.39%% 
Sum C 2.8 2.7 
FM 4.7 2.1 
Shading 2.6 23 
Total responses 25.3 17.3 
Experimental situations 
Motor inhibition time 172.21 62.97%* 
Waiting-room 
activity score 1.92 3.13% 
TAT transcendence index 21.96 12.69** 
Cancellation test errors 3.00 4.25 


Guilford Factor T scale 39.42 36.25 
Or ferences between groups significant beyond the 


As to’ the specific 
spontaneous motor 
room, Table 2 reve: 
activity scores as the 
M: 


prediction concerning the 
activity in the waiting 
als a regular increase in 
groups change from high 


population in the previous study [15]. This 
relationship between 
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Sum C ratio emerged only for the waiting- 
room scores. 


Table 2 


Means of Waiting-Room Activity Ratings 
for High- and Low-M Ss Subdivided 
by Sum C Scores 


Rorschach Waiting-room | 
Group N variables activity 
“M SumC ratings | 
High M:LowC 14 23 12 = 
HighM:HighC 14 32 49 ne A 
Low M:LowC 18 04 1.2 mie 
Low M:HighC 14 03 5.2 3. 


The next phase of the analysis of san 
involved testing the hypothesis concerning a 
consistency of Ss from situation to situatio ‘ 
Two methods for ascertaining whether a com 
mon factor underlies M and the five ing 
mental situations were employed. ‘The first 0 
these was Blomgvist’s test of relatedness [3], 
a nonparametric method which provides a i 
test of the significance of concomitant variation | 
of two or more tests for a common population. 
It involves dichotomization of all test saori 
into high and low and’makes no assumptions 
Concerning the distributions, For this reason it 
is useful with Rorschach data and particularly 
where the range of scores js quite limited, 4§ 
in the case of the M response in this group © 
schizophrenics. The technique does not, “ 


3 SE a : valk / 
course, provide the precise information 2 L 


able from a factor analysis which affords e 
estimate of the degree of relationship and 
the factor loadings of the various eae 
Applying Blomqvist’s test to the distri i 
tion of M, treated as one of a battery of test 


and to the five experimental situations resu T 
in a ¢ of 8.48, significant beyond the .001 ee 
This finding suggests that the six sets of score? 
are indeed grossly related. To evaluate the i 
tent to which all experimental situations shar 


z : nage ist’s 
in this concomitant variation, Blomgv!S* ? , 


7 : rS =f 
test was applied to the six sets of scores in pay? 


yielding the matrix vresented in associatio® 
with ż values in Table 3. It is apparent fro™ 
inspection of this table that a common facto” 
must indeed subsume J and these seemingly a 
verse test situations. Only the Guilford sca 
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fails to show uniformly significant p values for 
_ telatedness with the other tests. 


Table 3 


gas of p Values for Paired Experimental 
ituations Based upon Application of Blomqvist’s 
Test of Relatedness 


1 2 3 + 5 6 


1M <.01 <.01 <.05 <.01 >.01 
. 2. Motor 
| inhibition <.01 <.01 <.05 <.05 >.20 
| 3, Waiting 
r room <.01 <.01 <.01 <.05 >.20 
4. Transcen- 
dence SOS L0 <1 <.01 >.20 
5. Cancella- 
ton errors <.01 <.05 <.05 <.01 <.01 


6. Guilford’s 


Factor T  <.01 >.20 >.20 >.20 <.01 


ac Me application of Blomgvist’s test would 
eral eae to offer Support to the second gen- 
step in ey “aes of this investigation. The next 
lation of ids of the data involved the calcu- 
tween Re product-moment correlations be- 
tal es hach variables and the experimen- 
with eae. I his procedure was employed 
quality of 5° a ape because of the unknown 
tremely restri orschach distributions, the ex- 
ables in enn Tange of AL and other vari- 
the Aa ne the limited N, and, finally, 
total re ‘able interrelationship of M and the 
A (R), which cannot legitimately 
by partial correlation since the 
are not experimentally inde- 
e with Wittenborn’s reasoning 
the extraction of a centroid 
arried out 4 ’s multiple factor analysis 
YPothesis of tenia general attempt to test the 
this method _ commonality. The advantage of 
associatio 's that some indication of extent 
Schach variabl could be obtained. Other Ror- 
Might also is Se hearing on the common factor 
Cal ; Xpected to emerge. 
z alculation of Pe. 
» Vari 
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werk of AT an eof the ee 
m, and the eee inhibition, waiting 
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cancellation error scores showed trends in the 
expected direction, but the correlation coeffi- 
cients did not reach significance. Extraction of 
centroid factors for those variables which, fol- 
lowing a cluster analysis, showed sufficient 
significant interrelations revealed one clear fac- 
tor which had its highest loadings from M and 
the motor inhibition times (Table +). These 
findings tend to offer partial support to the 
second hypothesis. It is hoped that further re- 
search with larger groups and normal Ss who 
may be expected to show a greater range of M 
responses will provide a more suitable test of 
this hypothesis using the factor analytic ap- 
proach. 


Table + 


Matrix of Intercorrelations for M and Three 
Experimental Variables 


Variable 1 2 3; 4 
1.M -539 —.270 .347 
2. Motor inhibition 539 —.244 .293 
3. Waiting-room activity ~.270 —.244 —.077 
4. TAT transcendence 
index .347 .293 —.077 
Centroid factor 
loadings .749 .714 .376 .465 


A final use of correlation was attempted to 
evaluate the role of the color variables. Al- 
though Sum C and the separate color scores did 
not yield any significant relationships with 
other variables, inspection of Table 2 suggests 
that at least for waiting-room activity ratings 
some correlation between the M : Sum C ratio 
and experimental situations must exist. Scores 
from 1 to + were assigned to the High-M : 
Low-Sum C, High-M : High-Sum C, Low-M : 
Low-Sum C, and Low-M : High-Sum C groups 
in that order. Calculation of product-moment 
r’s for this M : Sum C score and the experimen- 
tal situations revealed no changes or lowering of 
their correlations with M alone. The correla- 
tion for the waiting-room scores,an¢ this vari- 
able was + .47, almost twice that obtaired 
when M alone was involved. Thus there seems 
to be here a hint of validity to Rorschach’s 
linkage of movement and color, and further ex- 
ploration with other behavioral correlates 
clearly seems warranted. 


Discussion 
The data of this investigation on the whole 
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lend support to the view that a person’s capac- 
ity or tendency to control overt motor activity 
is related to his capacity for imaginative or fan- 
tasy activity. Rorschach’s human movement 
determinant may indeed be a gross but valid 
measure of these alternative response tenden- 
cies. While specific predictions in the individual 
case are not warranted from the results pre- 
sented here, it is clear that this motor inhibi- 
tion—fantasy dimension merits more extensive 
exploration. Should further experimentation 
extend the scope of this triadic relationship of 
motion perception, motor response, and imagina- 
tion to other behavioral situations or to other 
populations, a new approach to understanding 
an important phase of personality development 
may be opened. Can it be shown that control 
of motor response, or, more generally, post- 
ponement of gratification is accompanied by in- 
creased activity on what Lewin [6] has termed 
the “level of irreality”? At least in moderation 
such control has great functional value for 
man. The ability to defer immediate motor re- 
_ sponse directed toward need gratification with 
the consequent resort to the realm of fantasy 
Chives man a control of his future through 
imagery and planning. Indeed such a pattern 
of postponement of immediate effort and evolu- 
tion of a timeless behavioral space available for 
what Freud [4] has called “experimental ac- 
tion” may well be one of the key phases of 
Maturation and, more broadly, civilization. It 
may also make possible a medium for experi- 
encing anxiety unknown to animals or primi- 
tive man. Rorschach’s M response is significant 
insofar as it serves as a measure of presumably 
long-standing personality characteristic reflect- 
ing this pattern of motor control and enhanced 
fantasy, Perhaps in a more refi 
quantifiable formt this threshold for Perception 
of humans in moti 
clue to important 
differentizte n 
diverse sube 


often repre- 
rican middle- 
red by tests of 
plex extensions 
an attempt to 
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his connection was re- 
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link early parental training or perceptions of 
familial figures to the development of the 
response and its behavioral correlates. 


Summary and Conclusions 


Previous studies in this series had demon- 
strated significant relationships between Ror- 
schach human movement responses and meas- 
ures of motor inhibition and spontaneous motor 
activity, thus affording partial support for Ror- 
schach’s postulated relationship of overt motor 
activity, perception of motion, and re 
The present investigation was designed as i 
partial replication of earlier work and an p 
tension to include measures of fantasy © 
imaginative capacity as well as motor activity. 
It was hypothesized that Ss differing in Ron 
schach M productivity would differ on tas 
tapping motor control and fantasy. It was si 
anticipated that they would manifest roug® 
consistency in their performance on the motor 
and fantasy situations in support of the genera 


theory of vicarious motor, sensory, and fantasy 
functioning. 


Sixty male schizophrenic patients who had 
recently been administered Rorschachs under- 
went five experimental procedures. The Ss 
were divided into High- and Low-/ groups 
on the basis of Rorschach protocols, two JZ of 
more being the dividing point. High-M 8s 
(N = 28) did not differ significantly from 
Low-M 8s (N = 32) in age, diagnosis, educt” 
tion, IQ, or other pertinent Rorschach vat 
ables. The experimental situations were: t h 
observation of Ss alone in a waiting room wal z 
räcings of the degree of activity manifeste s 
(b) a motor inhibition task, ability to write i 
phrase as slowly as possible; (c) Thematic Ap- 
Perception Test stories scored for transce? 
ence, i.e., introduction of content not actually 
represented in the stimulus; (d) Klebano” 
cancellation test scored for errors; (e) Gu! $ 
ford’s scale for the thinking introversion an 
tor (T) from the Inventory of Factors STD 
CR. Analyses of variance and ¢ tests were en- 
ployed to evaluate significance for the individ- 
ual tests. Correlational procedures and Blom 
Qvist’s nonparametric test of relatedness Wee 
employed to evaluate consistency of perfor™ 
ance from test to test. 


Results on the whole supported both gener al 


h 
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hypotheses. High-M Ss differed significantly 
from Low-J4 Ss by manifesting longer motor 
delaying capacity, less spontaneous activity dur- 
Ing the waiting period, and more frequent in- 
‘ena of characters or incidents not direct- 
y represented in TAT stimuli. They showed 
i trends to make fewer cancella- 
en ap and to present greater self-descrip- 
aioe, ae, introverts than did Low-M 
activity, k or the waiting-room spontaneous 
a ae he relationship of Rorschach color 
Portant me proved to be particularly im- 
Sudy. wae oe a finding in an earlier 
ee eae omqvist’s test, a significant in- 
Situations Sea of M and the five experimental 
a Ciiiener mergea, suggesting the presence of 
scores. Extr actor underlying the six sets of 
a pé na of a centroid factor from a 
Snif o eps ie which reached 
for M Sc ed fairly high factor loadings 
hibition, ate. activity scores, motor in- 
analytic procedu Pecan dence; The factor 
tenable sictistieat a though based on not very 
and these Pr a gd for this sample 
east partial su ions, also appears to lend at 
common shaven Rn to the hypothesis that a 
tol, motion ic factor underlies motor con- 

Perception, and fantasy behavior. 
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The Ammons FRPV Test and the WISC for 
Remedial Reading Cases’ 


Louis M. Smith and 


Psycho-Educational Clinic, 


The Ammons Full Range Picture Vocabu- 
lary Test and the Wechsler Intelligence Scale 
for Children were given to 91 children diag- 
nosed as reading disability cases at the Psycho- 
Educational Clinic. A reading disability was 
defined as a reading grade level, on a standard- 
ized achievement test, at least one year below 
the mental grade level on either the WISC or 
the Stanford-Binet. Eight of the subjects were 
girls and 82 were boys. The mean chronologi- 
cal age was 10.9 years, the mean reading grade 

Gas 3.2 years, and the mean intelligence level 
on the WISC was 101. Most of the children 
received both tests in the initial diagnostic in- 
terview, but some were given the Ammons 


while they were enrolled in the summer read- 
ing school, 


Form A and Form B 
comparable in mean and standard deviation. 
hen combined the mean was 107.89, the 
Standard deviation was 13.70. The mean of 
the WISC Verbal Scale was 99.66, Perform- 
ance Scale 101.87, and Full Scale 100.85, The 


7An extended report of this ş 
tained wit 


of the Ammons were 


and 
Educational Clinic, Uni- 

e from the American 
ter source, js 4321 hore at 
Auxiliary ubKeations Project, Photoduplication 
Service, Libra ashington 


Make checks Payable t 
Service, Library of Cong 


Arline R. Fillmore 


University of Minnesota 6 


standard deviations were Eei iger 
12.51, and 10.71. The correlation 8 90. 
Form A and Form B of the Ammons wa ingle 
The two forms were combined into “WIS 
scale and then correlated with the “a ha 
scales. The correlations were .73 in ale, 
Verbal Scale, .54 with the Performance 
-75 with the Full Scale, and .61 with the _ 
score of the Vocabulary subtest. When the a 
relation between the combined forms of Ps 
Ammons and the WISC Full Scale was “the 
rected for the restriction of range on 
WISC, the value was raised to .82. 1 that 

In conclusion, the present writers feel tel- 
the Ammons is a useful screening test nae 
ligence for children with reading hand! oe 
The differences in mean scores indicate re 
sible limitation. However, the full significan 
of this cannot be fully weighed at the P S 
time. Krugman, eż al. [1} reported pan ee: 
between the WISC and the anior > pres- 
similar in magnitude and direction to A the 
ent differences between the WISC an 
Ammons. 


Brief Report 
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A P Scale for the Rorschach: 
A Methodological Study 


Philip H. DuBois and Arnold H. Hilden 


iashington University 


y represents the application 
v method of item analysis 


Rorschach data. It can be readily 


and the sum o 


ve a 


at the total variance of a test can be 
nto two parts: the sum of the item 
f all the covariances 


: items. The total variance of a test 
Zero intercorrel 


ations among the items, 
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tem variances. Each item 
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ts unity would come from with- 


al, a Psychometric test should be de- 
measure a unitary characteristic, re- 
pets intercorrelations among the 

Correlations are too high and ap- 


makes too few discrimi- 


alue. With the type of mater- 
© present study, however, this dif- 
ot encountered. Our procedure for 
S Was to maximize the saturation, 
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It is readily apparent that maximizing the 
saturation is essentially the same operation as 
maximizing the internal consistency as esti- 
mated by Kuder-Richardson Formula 20. We 
can convert a saturation coefficient into rst by 
multiplying by 2 in which z is the number 


ne | 
of items. 

It occurred to us that this procedure offered 
promise as a method of scaling Rorschach vari- 
ables. Rorschach literature, while voluminous, 
has not drawn heavily on conventional psy- 
chometric methods. 

The popular response, P, was defined bis 
Rorschach [8, p. 359] as follows: “The vulë 
gar answers represent the share in the collec- 
tive or common method of sensing anything.” 
Subsequently, a number of authors have ex- 
pressed various definitions or rationales under- 
lying the popular concept. Hertz [4], Beck 
[1, 2], Klopfer [5], and Rapaport [7], among 
others, have proposed different P lists. All, in- 
cluding Rorschach, define P on a definitely 
statistical basis. It is one of the few Ror- 
schach categories so defined. There is, how- 
ever, variation as to the exact statistical cri- 
terion. Klopfer says [5, p. 177] that “the term 
popular refers to . . . responses given most fre- 
quently . . . to a particular blot area” and “it 
seems most reasonable to use the total number 
cf subjects . . . as a basis for determining the 
frequency with which a concert: kw been se 
lected.” He states that since a frequency tabu- 
lation of universal validity is not available, he 
has substituted a selected sample of popular 
responses which meet four qualifications: (a) 
they must occur frequently; (b) frequently 
used determinants must be present; (c) any 
“normal” person should be able to accept them; 
and (d) a D or IF must be involved. 
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Beck insists that P is based on form alone. 
Rapaport gives no exact criterion, but states 
that “they must occur in at least every 4 or 5 
records” [7, p. 313]. Hertz [4] uses a definite 
Statistical basis. Beck [2] has used the most 
definite and elaborate basis, and has made 
the most exhaustive attempt to arrive at cri- 
teria for establishment of P responses. 


In the present study the lists proposed by 
these four authors were taken as representative 
of populars used in clinical practice in this 
country. The four lists were combined into a 
composite list of 47 items, many of which were 
alternates or variations of others on the list. 
While the four authors are not in complete 
agreement on any item, the list was drawn up 


so that each of the four authors was fully rep- 
resented. 


Subjects 


The subjects consisted of 200 normal adults, 
normal in the sense that they were not clinic 
patients. Most of them were tested by gradu- 
ate students enrolled in a projective technique 
course, while the others were tested by one of 

Zithe authors. 

The population, consisting of 100 males and 
100 females, was randomly divided into two 
groups, Group A, an experimental group, and 
Group B, a cross-validation group. Mean ages 
were 31.6 and 30.4 years, respectively. 


Procedure 


j For Group A, the entire matrix of item var- 
lances and covariances 
puted. Saturati 


liability coeffici 


In order to devlop a homogeneous scale of 
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Table 1 


Saturations and Reliabilities (by Kuder- 
Richardson Formula 20) of the Several P Scales 


Group A Group B_ Combined 
Author n S rip S m S u 
Beck 21 48 51 41 43 45 AT 
Hertz 20 .36 .38 .39 41 38 40 
Klopfer 10 15 .17 24 .27 20 22 


32 
Rapaport 13 24 .26 .35 .38 «30 
Saturation is: 63 67 Sl St 


Rorschach populars, the entire collection of ‘a 
items was considered as a source of possibilities. 
However, a number of the items, as indicate 
in Table 2, were considered as overlapping, 
representing definitions by different authors / 
the same general idea. Accordingly, only one 0f 
the items in such a group of “overlapping 
was considered for inclusion at any one times 
A nucleus of four items having the highest 
available interitem covariances was selected 4S 
a starting point. This nucleus consisted © 
items 1, 13, 19, and 23, as listed in Table 2 
At each stage in the development of the satura- 
tion scale, all items were tested for inclusion 
in or exclusion from the nucleus. S. 
It has been shown [6] that any item, 7, 2° 


. ; j ae 
included in the nucleus, will add to the satur 
tion if 


2Cz; + a; > os i 
* Zo; 


On the other hand any item, 4, included in 
nucleus, should be removed if 


20%, — 07% 


20"; or 


o? 7 ! 
the : 


a 


+. the 
A peculiar problem was encountered ne 
construction of the present scale in the m4 de- 
of alternative possibilities, that is, different q% 
finitions of the same general idea. According é 
a formua was developed to determine whe 
any -specific interchange would add to 
saturation. 
If j is any item in the nucleus and RI a 
item outside the nuclevs, the saturation H 
e increased if the following inequality ho: 
o, (o°; i o*;) > do; (20 jx an 265i 


— 20% — 07; — 0%). 
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*e Ttems remai 
wae] 
grou; 
Under « 4 
Capital Jett, 
arenthese: 
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Table 2 
* Composite P List 
aem Percentage Card and 
d passed** location Source Content of the popular responses 
A B 
z5 58 55 LW BHKR Ban butterfly, moth (R omits moth) 
5 4 1 IL, W H Bird (also item 1) 
4 2 5 I, Ww K Winged creature (also item 1) 
5 61 61 IW K Items 1, 2, and 3 combined (generic concept) 
6* i 0 I, W H Face of a person (not animal or cat) 
7 10 11 I, D3 B Lower part of body (D4 if D3 attended to) 
g R 21. D#m, ý BH R Human being 
p 9a z 1 ll, W, y2 R Bear, dog 
10 F 33 Il, D1 B R Bear, dog , 
11 a 40 TE. Di, 7 H Bear, dog, cow, animal . i 
12% 7 35 II, D1 K Bear, dog, rabbit, bull, rhinoceros variety 
13% a y Il, D3 B Butterfly, moth , 
14 #6 83 Ill, D1,9 B R Human beings (with or without M) 
fis 21 79 Ill, D1,9 HK Human beings (only if M is present) 
167 32 20 Ill, D3 B Bow, bow-tie, hair ribbon 
17 46 36 Ill, D3 HKR Butterfly, or item 15 
18 7 35 IV, W BH R Animal skin 
198 7 17 IV, D2,6 H Boot, foot, shoe , 
20 A 86 V W BHKR Bat, butterfly, moth (R omits moth) 
21 00 6 V, W H Bird (also item 20) 
22* 12 92 V, W K Winged creature, or items 19 or 20 
fz 51 17 V, D1 B Leg, animal or human a 
24% 37 65 Yh WP a BH R Animal skin (F only or with shading) © 
254 51 46 VI, W, D1 K Animal skin, only when shading is present 
26 es 51 VII, D1 BH R Face or head of human (also if D2, 12, W used) 
27 89 67 VIII, D1 B Animal (Beck’s list) 
28 51 83 VIII, D1 H Animal (Hertz’s list) 
29 93 50 VIII, D1 K Four-legged animal, with FM 
30% 21 90 VIII, D1 R Animal 
31 24 VEL D3 BH Vertebrae, ribs, bone structure 
4 326 k 9 VILI, D4 BH Tree, bush 
{33 14 20 IX, D3 B R Human being 
34% 16 17> IX, D4 B Face, head; of a man 
35% 16 17 IX, D4 H Face, head; person, not female 
36 20 IX, D2 H Face, head; of animal (Hertz’s list) 
37% Ps 3 IX, D9 H Tree 
38 34 41 X, Di B Spider, crab, lobster, crustacean 
39 33 39 X, D1 H Spider, crab, octopus, crustacean 
40 58 25 X, D1 R Crab, octopus 
4i» 17 46 X Di K Many-legged animal, or items 37, 38, 39 
42l = 14 X, D2 B Dog 
43% 26 24 X, D4 Worm, caterpillar, serpent (F or FC) 
44 18 34 X, D4 H Seahorse, or item 42 
45% 21 20 X, D4 Elongated animal, with use of color 
So o a Z on BH R Rabbit head i 
3 9 33 X, Ds K Animal head with ears or horns, or item 45 
4 11 X, Di2 B Sheep 


TE 

E in the maximum saturation scale. 
consists of ~00 cases. 
era ae) nrmbers refer to Beck’s D notation. 
Ur E dual er to Beck, Hertz, Klopfer, and Rapaport, respectively. 
i Item 16 not commen, Overlapping items. 

tem 42 h a as to Hertz; noted too late to change. 
© no author; inserted to test with or without color. £ 
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Of the 47 items considered, 18 yielded a 
saturation of .63 in the experimental group. 
This was the maximum saturation possible, 
using no more than one of any group of “‘over- 
lapping” items. These 18 items are designated 
with asterisks in Table 2. 

Since a maximizing procedure was em- 
ployed, the true characteristics of the P scale 
so developed should be estimated from Group 
B. Here the saturation is .51 and the reliability 
as estimated by Kuder-Richardson Formula 20 
is .54. This was the highest internal consist- 
ency measure found for any of. these scales, but 
obviously leaves much to be desired. 


Table 3 
Intercorrelations of P Scales 
(N = 200) 
g 
5 # £ 
Author n 8 E = M o 
HM ë & 
Beck 21 .88 71 86 88 7.06 2.62 
Hertz 20 76 82 83 7.12 2.22 
Klopfer 10 68 +73 4.85 1.61 
Napaport 13 71 5.80 1.81 
aturation 18 5.61 2.73 


» none of which 
High intercorrelations are 
to be expected because of overlap in rationale 
of the items and in actual item content, The 
Saturation scale correlated .88 with Beck’ 


r generic 
ard 1 for the whole 


merely the bat, the 
but not a bird or a 
eric term? There are 
which such a question 
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could well arise. This point was tested during 
the investigation by replacing more specific 
terms by the more generic ones. In no instance 
was the saturation affected by more than a 
point or two. 
Conclusions 

Of the lists of populars proposed by four 
authors, Beck’s scale exhibits the highest in- 
ternal consistency. Its reliability, however, is 
definitely lower than that of acceptable psycho- 
metric devices. A revised list of 18 items, dE 
veloped during the present investigation, 1$ A 
slight improvement over Beck. x 

The present study indicates that orthodo 
Psychometric methods can be used with ae 
tive material and will aid in the improvemen 
of posited variables. The authors of this paper, 
a practicing clinician and a worker with con- 
ventional tests, were both surprised by the out- 
come. The internal consistency of the P scale, 
as developed by saturation analysis, was neither 
as high as the clinician expected nor as low as 
the psychometrician believed. i 

Variables which have a high degree of wa 
ternal consistency may or may not be useful. 
Variables which have neither internal consist- 
ency nor external validity are certainly use- 
less. It would appear that further examination 
of Rorschach variables is indicated. 
Received February 22, 1954. 
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Sex, Age, and Iconicity as Factors in 
Projective Film Tests’ 


Charles J. McIntyre 
The Instructional Film Research Program? 


The Pennsylvania State University 


Be p iiy pis undertaken to investigate 
eves | e T. of sound motion pic- 
a a pe ium for projective personality 

» and to attempt to define some of the 


Characterist; i 
a a istigs which should be built into such 


t a rious studies [2 4, 5] have indicated 
Powerful aa Produced films may provide a 
O attempt : tool for personality assessment. 
ever, to E made in these studies, how- 
or to any an Strate that films might be superi- 
tive test h ventional or widely used projec- 
y hs e Thematic Apperception Test 

is he example. Such a demonstration 
Cost of prodi ne if one is to justify the 
tematic Attem e new test. Nor has any sys- 
icate What is een made previously to in- 
ave in order ie such films should 

slated to be maximally effective. 
bility of wes involves the desira- 
Not only ale on a criterion measure which 
Variables tested Permit evaluating the limited 
Serve’ as a aa e study, but which could 
or evaluating vely quick and simple metliod 
teristicg Ser eo of many stimulus charac- 
Structing ‘hoe evaluated before con- 
ince the ae Picture’ projective test. 

aPpears to uccess of picture projective tests 
Which stibtees dependent upon the degree to 
Stimuli aon cS (Ss) interpretations of the 
Hes, the y Projections of their own personali- 
py. rables were evaluated in terms of 


aPpears 


1s 
Sı ; > Paper 
ee submitted ions the substance of a dis- 
£ for the Ph Partia! fulfillment of the re- 


nia 3 
= State niversity h. D. degree at the Pennsylva- 


ÀS resea a 5 
Pilm onr-269. op os carried out under contract 
Unive esearch Pig > I between the Instructional 
of N sity, and th gs am, The Pennsylvania State 
aval Resear” Speciai Devices Center, Office 


the relative degree to which they permitted or 
encouraged projection onto the central figure 
(hero, protagonist). 

The emphasis, which appears again and 
again in TAT literature, upon making the cen- 
tral figure like § with respect to age, sex, 
color, body-build, etc., in order to increase pro- 
jection is directed to the end of making it 
possible for § to perceive the protagonist as be- 
ing like himself. In fact, this appears to be the 
central meaning of projection in this context; 
namely, that an § has projected to the extent | 
that his reported perception of the protagonis 
agrees with his perception of himself. This i 
the operational definition of projection used 
throughout this study. 

The following hypotheses were tested. 

1. There is a greater than chance agreement 
between an S’s perception of himself and his 
perception of an ambiguous film protagonist. 

This hypothesis means, in terms of the oper- 
ational definition, that persons viewing an am- 
biguous film will project their own self-percep- 
tions onto the protagonist. 

2. Provided that the total picture remains 
ambiguous, the amount of projection elicited 
by a protagonist will increase as the iconicity 
of the protagonist increases. 

Iconicity is a term borrowed from semantics. 
%t is used here to mean something akin to life- 
likeness or realism. Apparent! , Ge peculiar 
advantage of pictures, and especially motion 
pictures, over other forms of representational 
art is the great realism with which persons or 
things can be portrayed. 

3. The Ss will project more onto protago- 
nists of the same sex than onto protagonists of 
the opposite sex. 

4. The Ss will project more onto protago- 
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nists of the same apparent age as the 8s’ 
than onto protagonists whose apparent age is 
different from the Ss’. 

Hypotheses 2, 3, 4 are all based upon the as- 
sumption that increased subject-protagonist 
similarity will result in increased projection. 
In hypothesis 2 the element of similarity is, of 
course, realism or lifelikeness. It says, in effect, 
that the probability for projection occurring is 
increased as the protagonists become more like 
real people and less like paintings or still pic- 
tures of people. 

The assumption that increased similarity re- 
sults in increased Projection permeates the 
TAT literature. It was made specifically by 
Murray [7], Thompson [12], and Symonds 
[11]. It is implicit in the studies of Crandall 
[1], and Heppell and Raimy [6] when, in 
selecting pictures to elicit information in 
specific areas, they were careful to stipulate 
that at least one character in their pictures be 
of the same sex and age as the persons to be 
tested. In addition, among the rules set forth 
by Rotter for determining onto which figure 
‘an S is projecting, one finds, “The subject is 

likely to identify with a character of the same 
sex, either one of his own age or a previous 
age. For example, a young male adult might 
identify with a young male adult or a boy in 
the story but would be unlikely to identify 
himself with an older person, or a female of 
any age” [9, p. 82]. “Identify” in this context 
apparently means to Project one’s own charac- 
teristics onto a particular figure in the card. 

It should be noted, however, that this as- 
sumption is not supported by th 
Riess, Schwartz, and Cottingham [8, 10] and 


Weisskopf and Dunlevy (13, 14] which, while 
they do not i 


may be, they are more subtle than 
physical similarity. 


t Procedures 

The films. In all treatments, the stimulus 
materials were 16-mm, motion pictures which 
from the beginning of the fade-in to the end 
of the fade-out were each 35 seconds long. 
Five film versions were produced for each of 
five scenes, plus an additional film which was 


shown at the begining of each experimental 
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, a s 
session as a practice exercise. Thus, there Ip 
a total of twenty-five different experimen 
films plus one practice film. sah 
2 ic 
The five experimental scenes upon wa 
the versions were built were selected non a 
TAT cards so as to embody the sex an ra 
variables of the study. Since it was ora 
to duplicate as nearly as posila sha, pee 
in the motion pictures, the selection o ai 
was limited, in that it was necessary oe 
persons who looked like the TAT pier 
they were portraying, and to find curd 
for shooting which were like those of the ait 
An additional limiting factor was the nec a 
of selecting scenes in which the pose was 
tively static rather than one implying a oie 
The action versions of the scene had to oi 
form to the general principle of a an 
it was found in planning the scripts eo & 
action coming before or after a ee 
pose tended to define the meaning of tae aa 
When a pose was essentially static it wa Hat 
tively easy to get an actor into or out 0 el 
pose without giving, definition to et, 
With these limitations in mind, the fol = the 
scenes were selected as the variables to tes 
age and sex hypotheses: 1 1) 
Scene 1. Variable: Young boy ATAT Ee ae 
A young boy is contemplating a violin whi 
on a table in front of him. -d 20) 
Scene 2. Variable: Young man (TAT sare aa 
The dimly illumined figure of a man (r night. 
leaning against a lamppost in the dead o 4 AT 
Eron [3] in his normatiye study of : 8 
found that 20 per cent of nonhospitalizeo = 
identified the figure in card 20. To avol n, ss ¥ 
inating the data because of ct EGE glee stu 
were tested with this scene in the pres roximatê 
were required to indicate the sex and Siy the 
age of the figure. Those who did not i inated i? 
figure as that of a young man were elim 
the statistical analysis. d 8- 
i Car 
Scene 3. Variable: Young woman beagle han 
GF) A young woman sits with her chin in 
looking off into spice. M) 
rd 7B 
Scene 4. Variable: Old man (TAT ani wh 
A gray-haired man is looking at a younger 
is sullenly staring into space. es, 
Although there are two persons in this se 


l 
Ea a the 0 
were told to make their judgments about 

man ‘only, 


M) 
Scene 5. Variable: Old woman (TAT Çara Ped 
A short elderly woman stands with her bac nwa 
to a tall young man. The latter is looking dow 
with a perplexed expressions, 
As in Scene 4, there are two: persons in th 


t t 
The Ss were told to make their judgments abou 
old woman only, 


mis- 
tam- 
N ho 


js scene 


———— 
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Scene 6. The practi 

. practice scene shown to all groups 

ear Card 44). The silhouette of a young man 

th voman) against a bright window. The rest of 
e picture is totally black. 


Tiaia a of iconicity was built into the 
RA e : versions of each of the five 
Sor aie r ar been defined as lifelike- 
Sousi an aoe n y ig development of the ver- 
cessive version pa was made to keep each suc- 
identical as ees particular scene as nearly 
that would neat : while adding elements 
more lifelike a i the characters more real or 

hus, Versi pa in the preceding version. 
was the — La photograph of a TAT card, 
card were n ra since the figures in the 
People, The ro y drawn representations of 
lifelike in th te in Version 2 were more 
People fater. x ley were photographs of real 
Characters a, Sa drawings. In Version 3, the 
endowed with ed into the scene and thus were 
i.e, motion. V another attribute of real people, 
ersion 3° E 4 extended the principle of 
eq and interaét a be characters manipulat- 
sion 5 attesipted with thejr environment. Ver- 
chavior Isoin a add another dimension of 
Since the a with people, namely, speech. 
intelligible in po In Version 5 was made un- 
€ that this tek er tọ retain ambiguity, it may 
rsion was actually less lifelike 
er versions rather than more, as 
ach Fat, it can be seen that the in- 
tokenak M: to add increments of life- 
ake the whens creeding version in order to 
People than j cters more like real, living 
te meas n the preceding versions. 

f this study ti of projection. For the purpose 

efined as A Projection has been operationally 
Perception rs nae to which an individual’s 
Perception of ‘hi M protagonist agrees with his 

Sle Person lity self. The Minnesota Multi- 
Used as a the aT Inventory (MMPI) was 
to sample w anas Which items were drawn 
i Pereeption ae of the protagonist and 
3 fil sequence themselves. That is, after 
ot edad true or bie shown, Ss WER asked 
who's or example a to 26 questions “vhich 
Afey cels more ce nis is the sort of person 
Onj F respon ing to ed than most people do. 
Hem Westions, Ss a perception-of-protag- 

Selves during e took an MMPI for 
nswer rg the course of which they 
an item which read, “I think 


IKeness 


a 


339 


that I feel more intensely than most people do.” 
When an S’s answer to the question with respect 
to the protagonist was the same as his answer 
with respect to himself, this was scored as a 
“unit of projection” and the sum of these was 
his “projection” score. 

The full MMPI, rather than just the per- 
tinent 26 items, was administered in order to 
obscure from Ss the relationship between 
the items in the film test and the items in the 
inventory. 

The items of the perception-of-protagonist 
test (the film test) were selected from the 
MMPI by two persons working independent- 
ly. Only those items were used which both 
agreed met the following criteria: 

1. The item should not be objectively answerable 
from the film. That is, there should be nothing about 
the appearance or action of the protagonist which 


would suggest a “correct” answer. 
2. An item should not have a distinctly “abnor- 
mal” answer. Thus an item such as “Someone has 


control of my mind” although perhaps suitable ac- 
cording to criterion 1, would be unsuitable, since 
most people would answer this false for themselves 
and false for the protagonist merely by inference 
and thus, by the measure, be “projecting” with re- 


spect to this item. 

3. In the interest of subject cooperation an 
motivation an item should have the appearance of 
being answerable from the film. An item such as, 
“My hands and feet are usually warm enough” 
would be rejected since an § would be likely to feel 
that he could not reasonably be expected to answer 
this item with respect to a film protagonist. 

4. Items should be drawn from various scales of 
the personality inventory in approximately equal 
number. 


The numbers of the 26 MMPI items used 
with each of the sequences were: 8, 13, 26, 32, 
39, 54, 64, 79, 82, 91, 93, 94, 102, 165, 171, 
242, 257, 267, 292, 299, 336, 362, 371, 399, 
407, 416. 

The subjects. The Ss were 425 college 
students in elementary courses in education, 
psychology, and sociology. They were assigned 

randomly to the treatments. Each © saw only 
one of the twenty-five different, sequences. 
Hence, the total subject pool was divided ran- 
domly into 25 groups of 7 men and 10 women 
each. 

Test administration. The screen image was 
held constant at 581 inches wide and 44 inch- 
es high. The arbitrary image size was dictated 
by the size of the smallest room (and therefore 
minimum projector-to-screen distance) avail- 
able for the experiment. © 
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In summary, the Ss were told that it is well 
accepted that one of the chief characteristics 
of motion pictures is their ability to portray 
complex human emotions, feelings, and inter- 
actions, but that the ability of the actors is 
only one aspect of this. This experiment, they 
were told, was being conducted to find out 
about another aspect, namely, the ability of 
the audience to understand and interpret what 
they had seen. Hence, the Ss were told they 
would see a very brief scene and would then be 
asked to make certain judgment about it. They 


were urged to guess when they could not be 
sure of their answers. 


Following the instructions, the practice 
Scene was shown. The Ss then had 3 minutes to 
answer 20 questions written by E so as to 
be relatively easy to answer in order to en- 
courage Ss to think that the task was not 
really difficult. The same scene was then shown 
again and the Ss given a short period to com- 
plete answering the questions. The Ss did not 
know that this was a practice exercise. Follow- 
ing this the experimental film was shown, Ss 

aayere given 3 minutes to answer the 26 selected 
“items, the same film was shown again, and Ss 
were given another brief period to complete 
answering the questions for that film. After 
the test papers were collected, it was explained 
that E was interested in relating their judg- 
ments of the film characters to certain aspects 
of personality and that, therefore, they were 
being asked to complete a personality inven- 
tory. The Ss were Permitted to work at their 
own speed and leave when they had finished. 


Results 


The experiment has the form ofa 5X 5 X 2 
factorial design. There were five scenes, each 


Table 1 
Analysis of Vari 


ance of Projection Scores 

Source of variation df Mean square Fr 
Between versions 4 57.3705 1.34 
Between scenes 4 341.3176 7.985% 
Between sexes 1 2.7880 = 
Version X scene 16 54.1073 1.65 
Version sex 4 25.7330 — 
Scene X sex 4 54.7306 1.67 
Version X scene X sext6 32.7392 1.77% 
Within groups 375 18.5386 : 

Total 424 

* Indicates significanse at 5% level, 

** Indicates significance at `% level, 
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varying five ways (versions) with the a 
grouped by sex. Analysis of variance was a 
principal statistical technique. The data we ; 
tested, and it was shown that the come > 
normally distributed scores and homogeneity 
of variance, necessary in the analysis of var 
iance, were met. mr: 

The analysis of variance is summarized in 

able 1. ao 
E will be seen in Table 1 that the a 
ences between the means of the scenes pis 
highly significant. It was therefore apprann í 
to determine the nature and extent of these a 
ferences by means of ¢ tests. These results @ 
summarized in Table 2. 


Table 2 


Differences between Means of Scenes 


of of i 
Mean Scene Mean Scene Difference 
12.86 1 11.78 2 LOE 
12.86 1 10.93 3 1,938" 
12.86 1 16.19 4 a 
12.86 1 13.31 5 = 
11.78 2 10.93 3 85 
11.78 2 16.19 4 =e 
11.78 2 13.31 5 ad 
10.93 3 16.19 4 ae 
10.93 3 13.31 5 E 
16.19 4 13.32 5 a 


* Indicates significance at 5% level. i 
** Indicates significance at the 1% level, 


It will be seen in Table 2 that the P 
projection score for Scene 4 (old man) an 
significantly greater than cny other scene, was 
the mean score for Scene 5 (old woman) ene 
significantly greater than the mean of SC 
2 and 3. {f prov 

Because of the nature of the measure 0 ie 
jection the need for additional analysis öre 
dicated. Since an individual’s projection re 
was the sum of the times he answered om? y. 
the same way on each of two tests, mere a 
chance an § might be said to be “projecti en 
with respec: to a particular item 50 per ee 
of the time and thus might be expected to 8° a- 
“projection” score of 13 (26/2) by et wil 
lone.rPhe mean projection score over all Ss Y an 
13.01 Because the obtained and chance a a 
Scores were virtually identical, chi-square aii 
ues were computed for te agreement betw E 
answers to each item in Lath tests. The ae 
quency of obtained chi squares for each of t ý 
26 items was compared to the chance distribU 
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non of chi square. The resulting chi-square 
value yielded, a ~ of approximately .15. Hence, 
the observed distribution of chi square for the 
A items did not differ significantly from the 
distribution that would be expected to arise if 
only chance were operating. 
B implications of these findings in terms 
€ specific hypotheses are discussed below. 
K h > at 1 predicted that Ss would pro- 
totis fin, wn characteristics onto an ambig- 
ed, ie. a ab The last finding report- 
ween the ve the frequency of agreement be- 
Was. che need items on the two tests (which 
significant] asure of projection) did not differ 
alone ta seems to indicate, if considered 
in this a cheer as defined and measured 
hand, th 5 peeing not occur. On the other 
scenes was si id for differences between 
cent level, gnificant well beyond the 1 per 
It could be true, 


: of course, that the present 
experiment was the s p 


« 3 
Shunde.ae 5 he “less-than-one-time-out-of- 
= pa = pore the differences occurred by 
more likel efinition, this event is unlikely. 
contradiction į pt aang of this apparent 
Projection o¢ S that no measurable degree of 
\ cat $ ‘curred with respect to Scenes 1, 
characteristics that 8s did project their own 
and, pane. re the protagonists of Scene 
Was sufficient cene 5. However, while there 
the film fect _nonchance agreement between 
Mean Projecti and MMPI items to raise the 
above al] 2 ay Score on Scene 4 significantly 
One other Scenes, and on Scene 5 above all 
Ments, when Scene, these nonchance agree- 
E scie grouped with the appareritly 
S of the other scenes, were insuf- 


Acient t 

o , z } 

ered gj ae chi-square values which dif- 
gni Ncantly from ee 


tt 

o pi can be said that Ss were found 
Onists, but D Some ambiguous film protag- 
-the result did not indicate that 

3 Boao was general. 
Would thea ee Predicted that projection 
Onist, e A with the iconicity of the potag- 
e versions. "Py variable was embodied in 
À a he between-versions F of 1.34 
one that no significant dif- 
~ 8G vies es means of versions were 
oe of al the fact that the scores of at 
the five scenes did not differ 
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significantly from chance, it was to be expected 
that the versions would not differ. When 
Scenes 4 and 5, in which there appears to have 
been projection not attributable to chance, 
were analyzed apart from the other scenes, no 
significant differences between the means of 
the versions of those scenes were found. Hy- 
pothesis 2 was not confirmed. 

3. The third hypothesis predicted that Ss 
would project more onto protagonists of the 
same sex than onto protagonists of the opposite 
sex. In Table 1, it will be seen that the scene 
X sex interaction term was not significant. In 
fact, both men and women projected most on- 
to the protagonist of Scene 4, an old man. 
Hence, this hypothesis was not confirmed. 

4. Hypothesis 4 predicted that Ss would pro- 
ject most onto protagonists of the same appar- 
ent age as themselves. Hence the greatest pro- 
jection should have occurred onto Scene 2 
(young man) and Scene 3 ( young woman). 
It will be seen in Table 2 that these two 
scenes were the least effective in eliciting pro- 
jection. The most effective scenes were 4 and 
5 in which the protagonists were an old man» 
and old woman respectively. Hypothesis 4 wd® 
not confirmed. 


Discussion 


This study was undertaken primarily to ob- 
tain information about the use of motion pic- 
tures for projective testing. While the results 
do not permit valid conclusions to be drawn 
about the relative effectiveness of films per se, 
some subjective impressions of the experimen- 
ter might appropriately be discussed here. 

One of the severest handicaps that a film 
suffers, when used as in this experiment, lies 
in the short time which may be given to § to 
view the stimulus scene. (In this instance, two 
showings of 35 seconds each.) In the conven- 
tional TAT administration, S may take vir- 


“tually as much time as he wishes for looking at 


the card. Furthermore, he has we card before 
him while he is telling his story. It may well 
be that this makes an important contribution 
to the value of a still picture for eliciting pro- 
jection because, with an essentially unlimited 
time to study the picture, § is provided with 
an always present source of material from 
which to elaborate his fantasies. 

It is rather difficult to provide as much time 
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in a motion picture as an S$ might effectively 
use, while retaining the necessary element of 
ambiguity and adding the presumably impor- 
tant element of realism. A motion picture is 
realistic partly because it depicts people be- 
having—acting and interacting. Normally, the 
more a person is shown behaving, the more 
the situation is defined, i. e., it loses am- 
biguity. While motion pictures can be produced 
showing people behaving without defining the 
situation, it is not certain, since it is not one’s 
usual experience with motion pictures or with 
life, that such a procedure does not detract 
from the realism of the scene. A film loop de- 
vice which would permit the repeated showing 
of a single short sequence could be used but, 
again, it is not certain that this would not im- 
pair the realism of the scene inasmuch as people 
normally do not repeat an identical action 
over and over. The same difficulty applies to 
sound, for it would seem that an ambiguous 
sound heard repeatedly either ceases to be am- 
biguous, or convinces the subject that it was 
not intended to be interpretable. 

ip These considerations are subjective and 
“Should not preclude further research in the 
area. They do, however, indicate some of the 
problems which must be met if a motion pic- 
ture test similar to the TAT is to be developed. 


Conclusions 
1. The perception of an ambiguous protag- 
Onist as being like oneself does not appear to be 
as generalized a Phenomenon as some of the 
TAT literature would indicate. Such projec- 


tion was found to occur but to a very limited 
extent. 


2. The ex, 


evidence to determine the 


3. With respect to sı 
did not support the h 
project more onto 
physically similar to ¢ 
study seemed to supp 
such similarity may 
jection, 


ex and age, this study 
ypothesis that Ss will 
Protagonists who are 
hemselyes, Indeed, this 
ort the conclusion that 
actually discourage pro- 


Charles J. McIntyre 


Summary 


A study was undertaken to investigate E 
probable effectiveness of sound motion pictur 
as a medium for projective personality terng 
and to attempt to define some of the characte: 
istics which should be built into such a E 

Short motion pictures, based upon five T. 
cards whose central figures differed by sex E 
age, were produced in such a way as to inc 
porate varying degrees of realism. vite 

The projection associated with each o: al 
three variables was measured and one 
Projection was operationally defined, as the 7 
tent to which a subject’s perception of hins 
agreed with his perception of the prora 

Little projection was found to occur. ah 
projection that did occur was associated W : 
the two parental-figure protagonists. No “i 
ferences in projection associated with the res 
ism variable were found. 
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A Note on the Use of a Paper-and-Pencil Form of 
the MMPI Hs Scale for Hospital Use 


Sol Charen 


Catholic University of America 


The use of a single scale of the MMPI, ac- 
cording to Machover and Anderson [Iih is 
often desirable in clinical practice. This is es- 
pecially true in hospital clinics and outpatient 
departments where some method of screening 
patients with neurotic symptoms from those 
with organic problems is needed. 

The 33 items of the Hs scale of the MMPI 
were mimeographed on a single sheet in the 
same sequence in which they appear in the 
group form booklet of the MMPI. Subjects 
were 50 hospitalized tuberculosis patients 
#thortly to be discharged as arrested cases. 
Their median age was 35 years with the age 
range from 21 to 69 years. 


The method of testing was identical to that 


1From the Veterans Administration Hospital, B 
timore, 


do not necessarily reflect the o 
the Veterans Administration. 


?The author wishes to tha: 
Chief of Medicine, VA Hosp: 
land for his help in making 
used in this research, 


nk Dr. Ross McLean, 
ital, Baltimore, Mary- 
available the patients 


An extended report of this study may be ob- 
tained without charge from Sol Charen, 200 Rhode 
Island Avenue, N, E., Washington 2, D. C. or for 
a fee from the American Documentation Institute. 
tter source order Document 
No. 4320 from ADI Auxiliary Publications Project, 


d ice, Library of Congress, 
Washington 2°- UE, remitting in advance $1.25 


for photocopies, Make checks 


t 
used by Machover and Anderson except ma 
the time interval between test and retest fe 
one week. The group-form booklet of n 
MMPI was used and testing was done ME 
groups. Half the patients were given the papa , 
and-pencil form of the Hs scale and a ed 
later were retested with the booklet. The ot 
25 were tested in reverse order. T 

The mean T score of the 50 subjects on j 
experimental form was 56.14 against a mean le 
57.87 for the group booklet form of the ae 
with equal to .73 for a two-tailed test- Me 
T scores for all methods of testing P 
from 55.20 to 59.80. The Pearson pro ier 
moment correlation between group en 
form of the Hs scale and the paper-and-P 
form was .980. 


le 
The paper-and-pencil form of the pee 
of the MMPI gave almost identical T The 
as a retest with the group ‘booklet am The 
correlation between the two was -98 seems) 
Paper-and-pencil form of the Hs scale ses an 
then, worth while for use in hospital clin in 
outpatient departments where quick 


and screening of patients is desirable. 


Brief Report 
Received June 16, 1954. 
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Transcendence Indices, Extent of Personality 
Factors in Fantasy Responses, and the Ambiguity 
of TAT Cards` 


Douglas T. Kenny 


University of British Columbia 


Paper is the third in a series concerned 


Pit the widely accepted assumption 
notonic relationship between stimulus 


ec 
oncepts of both stimulu. 


these terms 
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owing that 
Iguity elicit | 
Structure 
a the stimulus, 
.° Varying expos 


d ones, 


and the 


personality factors in 
Any study exploring this 
ncern itself with two pri- 
‘al considerations, namely, 
the meanings assigned to 


s ambiguity and 
way in which 


are to be measured 
Cissk 
e'sskopf [6, 7] has presented evidence 


€ss projection t 


pictures with low physical am- 
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Physical “impoverishment” 
by incomplete line tracings 
ure time, was used as an in- 
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ed on the mean number of re- 
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contrast to Weisskopf’s procedure, ambiguity 
was defined in terms of psychological rather 
than physical properties. Ambiguity was de- 
fined in terms of the estimated number of in- 
terpretations that judges thought would apply 
to each TAT picture. In analyzing the sig- 
nificance of personality factors based on TAT 
stories, Stephenson’s [+] Q-array technique 
was utilized rather than unidimensional scales 
or transcendence indices. 

It seems pertinent to relate these two differ- 
ent approaches that have been used in testing 
the monotonic relationship postulated between 
stimulus ambiguity and extent of personality, 
factors revealed in fantasy responses. Th 
present research aimed at investigating the re- 
lationship between projection, as defined by 
transcendence indices, and extent of personality 
factors revealed to TAT pictures, as deter- 
mined by a Q-array technique. It seems worth 
while to test Weisskopf’s assumption that there 
is a direct relationship between her transcend- 
ence indices and the extent of personality fac- 
tors introduced into TAT protocols. As yet, 
there is no empirical evidence to indicate that 
transcendence indices can be used as indicators 
of the amount of clinically interpretable ma- 
terial elicited by a picture. In addition, an at- 
tempt was made to see how transcendence in- 
dices varied as a function of physical ambiguity, 
psychological ambiguity, and stimulus ambig- 
uity involving a combination of both physical 
and psychological properties. 


Method 


Ascertaining Stimulus Ambiguity 
The three procedures for determining stim- 
ulus ambiguity were: 


Psychological ambiguity. From the first study [1], 
15 TAT cards varying in three degrees of psycho- 
e 
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logical ambiguity were obtained. A group of 51 
judges ranked 21 TAT cards in terms of the esti- 
mated number of interpretations each card possessed. 
By this procedure three sets of five cards, varying 
in three degrees of increasing psychological ambig- 
uity, were selected. Cards 5, 15, 18BM, 11, and 19 
TBM, SBME VAM and TORI made ap ihe Incr: 

» & M, an m nter. 
mediate group. Cards 12BG, 1, 2, 98M, and 17BM 
comprised the least ambiguous set. 

Physical ambiguity, In order to induce physical 
ambiguity, changes in the exposure time of the TAT 
cards were used. For the present study, the 15 TAT 
cards were photographed with approximately the 
same intensity as the standard set. The cards, on 
individual slides, were projected onto a screen, and 
the subjects were simply asked to describe the pro- 
jected picture. The pictures were shown to 80 sub- 


jects, using three to eight subjects at one time. 
All subjects were drawn from introductory psy- 
chology classes at the University of British Colum- 
bia. Forty male subjects described the pictures under 
a 5-second exposure time (high physical ambiguity), 
and another 40 male subjects described the pictures 
under a 2-minute exposure time (low physical am- 
biguity). 

Combined physical and psychological ambiguity. 
The 15 TAT cards were classified in terms of both 
„Physical and psychological dimensions of ambiguity 

y making use of Murray’s placement of the cards, 
“it will be recalled that Murray divided the cards 
into two groups of ten, cards numbered 10 and be- 
low being more structured than those numbered 11 
and above. Murray's placement of the cards was 
based on the physical characteristics of the cards 
as well as on diagnostic value. Of the 15 TAT 


cards, seven are from Murray’s first 10 and eight 
are from his second ten, 


Measurement of Personality Factors 


As indicated, the aim of this research was to 
determine the relationship between two meas- 
ures of fantasy responses to TAT pictures, a 
Q-array technique and transcendence indices. 

Tanscendence indices for each of the 15 TAT 
cards were obtained by scoring the descriptions 
that the subjects ave to the cards under the 
two exposure times. Weisskopf’s manual on the 
scoring for transcendence indices was em- 
ployed. Separate transcendence indices were 
worked out for the different exposure times 
For a detailed description of the Q-array ea 
ing method and the administration method of 
the TAT pictures, the reader is referred to the 
second paper in this series [2]. Suffice it to say 
here that the 15 TAT cards were administere4 
individually to 18 male college students, Two 
well-trained clinical psychologists, utilizing 
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the Q-array method, judged the significance p 
the personality factors “injected” into F A 
TAT stories. The correlation of the scores be 
tween the two clinicians was satisfactory (r= 
68). i 
ësults t 
The most "S. question likely ts arise 
isı What, if any, is the relationship bewwest 
the ranking of the TAT cards for revealing 
of the personality as determined by the on ; 
method and the ranking of the same car si ; 
terms of transcendence indices? The rank-or G 
correlations between personality revealingness 
and the transcendence indices were .62 and § 4 
for the 5-second and the 2-minute sere 
groups respectively. Statistical significance 1S 03 
yond the .01 level for the p of .64 and at the a 
level for the p of .62. The data clearly supra 
Weisskopf’s contention that transcendence 


: ; . sS 10 
dices are related to personality revealingn® | 


TAT pictures. nt 
A second question asked is: To what ext? n 

does the transcendence index vary as 2 cae 

of the physical ambiguity of the stimu 


Sess” the 
Table 1 presents this finding in terms © 
Table 1 tees 
Analysis of Variance of Transcendence In F 
Source of variation df Mean 
square gar" 
Between exposure times 1 ee i 
Subjects in same group 73 365 

Total between subjects 79 6 18.37" 
Psychological ambiguity level 2 oe 4.37° 
Ambiguity X exposure time ! 2 ~~ 
Pooled subjects X ambiguity «156 4.0 

Total within subjects 160 
Total 239 ee 

pd Significant at 5 per cent level. 

** Significant at 1 per cent level. The data 
difference between exposure times: ing t 
confirm Weisskopf’s findings in sho enika 
subjects reliably increase their trans 
indices under long exposure times. cendenc? 

A third question asked is: Do transc®" i m- 


indices vary with degree of psychologic clas 
biguity when the transcendence scores eine is 
sified under three sets of pictures vary" ame 
three degrees of increasing psychologi¢* gical 
biguity? The F for Between Psychol gi- 
Ambiguity Level, as shown in Table l, ree 
cates significant differences between the 
levels of psychological ambiguity. To nce 
mine which sets of cards show the differe 


dete” 


Transcendence, Personality Factors, and Ambiguity 


? tests were made between the sets using the 
Interaction of pooled subjects X ambiguities 
poa ie This analysis showed that 
higher cael ambiguity set had significantly 
: ranscendence indices than either the 
S oF least ambigugus sets: The differences 
ae significant at the 1 per cent level of con- 
th here were, however, no differences in 
wows and se indices between the most ambig- 
combined wit (tp ce cards. This finding, 
the cards ir Ps the previous finding [2] that 
‘significantly the median ambiguous set reveal 
those in a A personality factors than 
Shows that th cast and most ambiguous sets, 
ose cards which have higher trans- 


Cendence ing; 
veal ee indices are also the cards which re- 
© most about personality. 


Da . 

enon nee 1 also show a significant in- 
Psychologie ant length of exposure time and 
the di HN ambiguity level. Examination of 
shows that m involved in this interaction 
yielded highe a intermediate ambiguous set 
Most ambiguo transcendence indices than the 
Sut not ap A under long exposure time, 
intermediate ş short exposure time; also, the 
transcendence a showed significantly higher 
Set, under ej he ices than the least ambiguous 

either short or long exposure time. 


The š 

ransa a tion asked is: Are there higher 
the last ten yg for the TAT cards from 
° variance se a from the first ten? Analysis 
literences į Sults showed that there were no 
tween these e the “transcendence indices be- 
tYPõőthesis api os cards, Hence, Murray’s 
ton between hy difference in degree of projec- 
Porteg by ¢ ese two sets of cards is not sup- 
this twofold data, The interaction between 
time of e Classification of ambiguity and 
Xposure was not significant. 


Discussion 
“ee of the mo 
mesora A this 
eerPelated with 
tis Picture 
S iate psy 
ghey tran 


st interesting findings which 
Study are that the extent of 
ial revealed in a picture is 
at e transcendence index of 
skolan i cards from the inter- 
ik Tena fa y ambiguous set yield 
ast or most ence indices than either the 

ang Suppo ambiguous sets. The former 
Iregi relati rts Weisskopf’s assumption of a 

‘onship between amount of trans- 


s 


= 
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cendence and amount of personality factors. 
The latter result may be accounted for in 
terms of three possible factors which are de- 
scribed in greater detail elsewhere [2]. Briefly, 
transcendence indices may not have increased 
with’ increasing psychological ambiguity be- 
cause (a) ansiety, high may mount with ii 
creases in ambiguity, inhibited greater projec- 
tions; (2) the cue patterns in the three sets a 
cards do not vary as assumed ; or (c) there may 
have been qualitative differences among the 
three sets of cards. Any three of these plausible 
explanations may account for the obtained re- 
sults. 

The results of the present study, as well as 
Weisskopf’s research, do not conform to the 
theoretical expectation that increases in physi- 
cal ambiguity should be accompanied by in- 
creases in transcendence indices. In terms of 
the previous formulation of this problem [2], 
it may be hypothesized that a decreasing num- 
ber of cue constellations available for selective 
reactions produces response tendencies which 
do not contain much in the way of individual 

ù 


projections. 
Contrary toMurray’s hypothesis, cards fro 


his more structured series did not yield higher 
transcendence indices than cards from the less 
structured series. This finding substantiates the 
previous conclusion [2] that Murray’s most 
ambiguous set does not elicit more significant 
personality factors than his least ambiguous 
set. On the other hand, Weisskopf [5] found 
that the well-structured series actually elicited 
higher transcendence indices than the least 
structured series. This discrepant finding be- 
tween the two studies may be explained in 
terms of the differences in the TAT cards 
used in the two studies. 


Summary 


This paper describes an experiment relating 
the concepts of transcendence 2nd extent of 
personality factors in elicited fantasy. The re- 
sults are consistent with Weisskopf’s assump- 
tion that the extent of personality material re- 
vealed in a TAT picture is correlated with the 
transcendence index of the picture. In addi- 
tion, it was shown that with increasing Psy- 
chological ambiguity there is an initial increase 
in transcendence and then_a decrease. The the- 
oretical expectation that transcendence indices 
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should increase with increases in physical am- 
biguity was not substantiated. Finally, the ex- 
pectation that TAT cards from Murray’s 
second series should elicit higher transcendence 


indices than cards from his first series was not 
upheld. 
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A Psychotherapy Case Showing Progress but No 
Decrease in the Discomfort-Relief Quotient 
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The Purpose of thi z " 
„that a SEAN o thiis paper is to demonstrate 
there is no f nay show progress even though 
sion was rite in verbal tension. Verbal ten- 

uotient one by the Discomfort-Relief 
termining ike => an objective method ot de- 
Of a patient d €nsion expressed in the sentences 

The DR unng psychotherapy interviews. 
owrer [4] eo developed by Dollard and 
casework int © measure tension during social 
Cauffman TEG Mowrer [12, 13] and 
with it and e ey [10] have gone further 
uring nine i concluded that a tension drop 
DRQ, ind; otherapy, as measured by the 
“he DROS therapeutic progress. 
analysis proce Pied compared with a content- 
can be interpreted which shows changes that 
Method of ported aS indicating progress. The 
€ senior ities Tee was developed by 
R MOtivatio [14] on the basis of concepts 
Ing t cory > vee conflict derived from learn- 

The DRO Psychoanalytic theory. 

3 to the — in content analysis were 
by pc has receive q Ts. B., a psychotherapy 
ome ollard, Auld, and ete: clinical study 
eth this ual sh hite [2]. The exist- 
me the intere e study of the case will 

© clin Sted reader to evaluate better 


ical sign: 
su Signi hai 
Its Presented se nce of the quantitative re- 
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ing discomfort (drive, want, tension, pain, 
suffering), relief (drive reduction, reward, 
pleasure, relaxation), or neither. The DRQ is 
the number of discomfort units, divided by the 
number of discomfort units plus relief units. 
The resulting quotient is multiplied by 100 to 
provide a scale ranging from 0 (no tension) 
to 100 (all tension). 

In applying the DRQ to the case of Mrs. 
B., two graduate students independently 
scored summaries of all 17 therapy hours. 
These students were psychologically sophisti- 
cated but unfamiliar with the case. They scored 
the summaries in a random order so that they 
would not be influenced in their scoring by thg 
“plot” of the case or by preconceptions about 
the direction of tension change. Their agree- 
ment was high (r = +.92, df = 15, p< 01). 
Figure 1 shows the average DRQ of the two 
scorers for each of the therapy hours. It can be 
seen that, although there is some fluctuation 
in the DRQ from hour to hour, there is no 
consistent trend throughout the course of thera- 
py. There is neither a gradual decline in ver- 
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DISCOMFORT-RELIEF QUOTIENT 


°. 
i 3 5 7 9 n 13 15 17 
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Fig. 1. The Discomfort-Relief Quotient based on 
summaries of 17 consecutive therapy hours with 
Mrs. B. e 
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bal tension nor a sudden drop near the end of 
treatment. 

It is possible that the DRQ showed no de- 
cline because the summaries did not truly re- 
flect tension expressed in the patient’s sentences. 
In order to explore this possibility, two other 
psychologically sophisticated people applied the 
DRQ to the verbatim typescripts of six of the 
interviews. These scorers were given the pages 
of the six interviews in random order. The in- 
terviews were selected for typing in the fol- 
lowing way: five successive blocks of three or 
four hours were delineated and one hour was 
selected randomly from each block. Hour 11 
was added because it had been previously typed 
for the Dollard, Auld, and White book. The 
agreement of the two scorers was high (r= 
+.96, df=4, p < .01). The averaged results 


are shown in Figure 2. Again, no trend is ap- 
Parent. 
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his content-analysis 
where [14]. Scorers 
of the patient’s state- 
al categories. The re- 
four major categories: 
other and children (b) 
d husband, ( 


d, and (d . 
ety related to no one in io) general anxi- 
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anxiety or guilt about hostility. The sex conflict 
with the husband includes sexual desire, sexu 
anxiety, and hostility specifically related tO 
sexual frustration. 

The main judge in this study scored the 
typescripts of six therapy hours in a ino 
order. A psychologically naive scorer was use 
to check reliability. This person scored two 
hours with the main judge for training put 
poses and then scored the remaining four hours 
independently. Agreement between the tw? 
scorers for the four hours was high: for hos- 
tility to mother and children, r = +.997, df 
= 2, p < .01; for general hostility to husband, 
r= +.995, df = 2, p < .01; for sex conflict 
with husband, r= + .993, df = 2, p < -01i 
and for general anxiety, r = + .956, df = 2 
Ż < .05. In order to control for differences 19 
the total number of statements from hour tO 
hour, the raw frequency scores were converte 
into percentages of the total number of state- 
ments in the hour, 


The sum of all four categories reveals no 
striking change throughout therapy, as show 
in Figure 3. Whatever slight trend exists can 
be accounted for almost entirely by the high 
point on Hour 6. Although the precise shape © 
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this curve differs from the DRQ curve ™ 
Figure 2, the over-all impression is the same t 
The content analysis shows importan? 
changes in the patient’s speech when the sep“ 
Tate areas of conflict are considered. Duri” 
the course of therapy, the patient shifted fro” 
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ae about her conflict with her mother and 
ent oe kine about her conflicts with her 
ilt ais is shown in Figure 4, where 
fae oF ee related to mother and chil- 
ese a sum of the conflict categories 
tilit the husband (i.e., both general hos- 
= and sex) are plotted. 

ptr of the conflicts about the hus- 
shows th changed during therapy. Figure 5 
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sisted of criticisms of the husband’s attitudes 
toward social life, vacations, etc., and some 
guilt about these criticisms. The sex conflict 
included statements about the patient’s own 
frustration, statements blaming her husband, 
and eventually statements showing some in- 
sight into her own inhibitions. 


The content analysis, then, shows a change 
during the course of therapy from talking 
about a hostility conflict about the patient’s 
mother and children, to talking about a hos- 
tility conflict about unimportant matters con- 
cerning her husband and, finally, to talking 
about a fundamental sexual conflict about her 
husband. 


Discussion 


According to Dollard, Auld, and White 
[2], Mrs. B. made some progress in therapy, 
although her case was not a “finished” one. 
Their account of the case is briefly as follows: 


Mrs. B. began therapy with a defensive “cover 
story.” She complained that her mother had stolen 
away her children and that she (the patient) was 
unable to stand up for her rights in the situation, 
According to Dollard, Auld, and White, this bab; 
snatching was not a primary problem; indeed, Mr: 
B. had very little trouble asserting herself toward 
her mother or anyone else. The therapist refused to 
accept the cover story as an adequate explanation. 
He also insisted that she could not avoid discussing 
her marital life. Mrs. B. began to complain about 
her husband. At first she complained about unim- 
portant matters such as his lack of interest in parties. 
The therapist found it difficult to believe that these 
things had the overwhelming importance ascribed to 
them, He noted that the patient had said nothing at 
all about her sex life. Mrs. B. gradually began to 
talk about her sex life. She said at first that it was 
satisfactory; she failed to see any connection be- 
tween sex and her presenting symptoms of depres- 
sion. But as she followed the rule of free association 
she began talking about her sexual frustration and 
her husband’s inadequacy. Later she saw the role 
her own inhibitions played in the situation. She final- 
ly realized that her sexual feelings toward her 
father had been transferred to her husband along 
with her horror of committing incest. She had un- 
consciously rejected her marriage and her responsi- 
bilities to her children as well. Toward the end 
of therapy the patient reported that her husband 
had spontaneously commented that she “seemed 
much better in bed—more interested now.” Un- 
doubtedly Mrs. B. had not solved all of her prob- 
tems, but she had gained some insight. 


The results of the independent co 


ntent anal- 
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ysis are in remarkable agreement with the 
qualitative analysis. The content analysis shows 
a decrease in the category of “hostility conflict 
about mother and children,” which corre- 
sponds to what Dollard, Auld, and White call 
the “cover story.” The content analysis also 
shows the shift in verbalizations first to a gen- 
eral hostility conflict about the husband and 
then to a sexual conflict about the husband. 
The advantage of the content analysis is that 
it describes precisely and quantitatively thera- 
peutic events which the qualitative analysis 
describes in an impressionistic way. Moreover, 
the content analysis has been demonstrated to 
be reliable. The agreement between the content 
analysis and the qualitative analysis shows that 
the content analysis measures meaningful and 
theoretically relevant things. 


The DRQ did not show the decrease which 
is said to accompany progress. Several other in- 
vestigations have also 


between the DRQ and therapeutic progress. 
Hunt [7, 8] 


conflict. The pati 
about herself which apparently affected her 
ehavior outside of therapy. 
An im 
the D 


is much more likely that Mrs. B. experienced 


1 n discussing her sex- 
ual conflicts than she had while elaborating her 


cover story. In this connection, it is perhaps 
significant that the final content category of 
general, or free-floating, anxiety consistently 
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increased during therapy. 

There are many examples in the literature 
of the need to increase tension in ‘order to get 
therapeutic results. Freud [6] found it was 
necessary to break through /a belle indifférence 
of the hysteric to achieve therapeutic results. 
The isolation of emotion from thought in the 
obsessive-compulsive has proved a stumbling 
block in therapy; it is only when such a patient 
feels tense that progress is made [5]. Alex: 
ander and French [1] have cited many cases 
in which the frequency of contacts was purpose” 
ly manipulated to increase tension. The au- 
thors believe that “. . , every analysis should be 
conducted on as high an emotional level as the 
patient’s ego can stand without diminishing its 
capacity for insight” [1, p. 30]. Miller's the- 
ory of conflict [11] provides a rationale for 
these empirical findings. According to this 
theory, when a therapeutic tactic enables 4 
patient to approach closer to a feared goal, the 
absolute level of fear is increased. The result 
has been called the negative therapeutic effect 
[3], since the increased fear often brings about 
a return of symptoms. Therefore, although pe 
would expect an eventual reduction of ie 
in a successful patient’s everyday life, we vor 
not necessarily expect a reduction of tension ae 
the therapeutic situation, particularly in shor 
term therapy. Í 

The foregoing analysis raises the problem © 
why the patient stays in therapy in the ae 
increasing tension, The answer is partly a 
many patients leave therapy when anxiety to 
creases. In successful cases, the tendency 3] 
leave seems to be counterbalanced by aa. 
little understood factors. First, there are ™ ne 
rewarding features of the transference ee 
ship [3]. Second, the symptoms and ee 
drives which originaliy motivated the pa a 
to seek help continue to operate. Third, ae 
solution of minor problems eases the tene 
in the patient’s daily life to some extent # 


$ 5 ant 
reinforces hope of solving the more import 
Problems, ' 


Summary and Conclusions 


’ 1. The purpose of this study was to a 
that a psychotherapy case in which there is 
no drop in verbal tension might show progre 
in other ways, The Discomfort-Relief Que 
tient was used as a measure of verbal tensio 


and is i i 
4 content analysis in terms of motivation 


and conflict 
was used to 
chang : 2 show other verbal 


a Separate applications of the DRQ 

nee me of Mrs. B. showed no change in 

ge ston during therapy. Each application 
¢monstrated to be reliable. 


3. 
den E bonteng analysis showed that during 
sion of a « Patient progressed from a discus- 
` flict with aa story” about a hostility con- 
flicts related h morer to a discussion of con- 
Brogresseq f o ner husband. Furthermore, she 
conflict Tora discussing a general hostility 
in relation to eras unimportant matters 
More fundam her husband to discussing much 
analysis ental sexual conflicts. The content 

4 Was shown to be reliable. 
shoy The result 

Own to be co 
Walitatiye clini 
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S of the content analysis were 
nsistent with an independent, 
cal analysis, 


It ; 
not reflect th Pointed out that the DRQ may 
t Was also € tension experienced by a patient. 
ua tension P edont that although an even- 
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ot necessarily he therapeutic situation would 
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i e co a 
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a Patient’s eet’ of the tension expressed in 
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The Effect of Childhood Diseases 
on IQ Variability ’ 


Lillian Wagenheim 
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Two previous studies by the writer showed 
a relationship between the early contraction of 
measles, chicken pox, mumps, and German 
measles and later school achievement. This re- 
lationship was found among boys who had con- 
tracted these diseases under age three and most 
significantly in those at age two. 


In the present study, the records of 493 boys 
were used. The data obtained included IQ’s, 
achievement grade level in reading and arith- 
metic, and the ages of contraction of the fol- 
lowing childhood diseases : measles, chicken 
pox, German measles, mumps, whooping cough, 
diphtheria, scarlet fever, tonsillitis, pneumonia, 
’ Cases were considered variable if two IQ 
Scores resulting from tests administered during 
different years showed a difference of 10 or 
more points, 

The contr 
litis, chicken 


man measles, 
did not show 
variability, 


and pneumonia under age five 
a significant relationship to IQ 


Boys who had contracted any disease under 
age five were more frequently found in the 


order Document No, 4319 from A 
cations Project, Photoduplication Service Library of 
Congress, Washington 25, D.C., remitting in a 
vance $1.75 for microfilm or $2.50 for Photocopies, 
Make checks payable to Chie > Photoduplication 
Service, Library of Congress, 


4 a up: 
variable group than in the jonvariable gia 
Chi square was 11.65 and significant bey 
the 1% level of confidence. E 

> » ‘ ani 
An especially interesting and ee a 7 
ing occurred when the records of childre 


pje 5 were 
different school achievement levels 


grouped separately. The cases had been divide 
on the basis of achievement in reading A 
arithmetic for a previous study. A child i“ 
functioned at least .7 of a grade below n 
chronological age level was considered an U 
derachiever, el 

Results significant at the 1% or 2% lew 
were found in the separate achievement groun 
at different age levels. The children who W 
underachievers in both reading and coe 
had the lowest median IQ. They also Los 
More variability in IQ wiien childhood hei 
had been contracted at ages two through WE 
Children who were underachievers in aA 
reading or arithmetic were average in IQ, dis- 
their intelligence was more variable when ug 
eases had been contracted at ages one po 2 
three. Those who were achieving in both y jQ 
ing and arithmetic were superior in med i 
and showed more variability in intelli 
when the diseases were contracted at ages 
through two years, | 


e 
It seems premature to attempt to answer i 
question as to whether the disturbance low" 
direct relationship to encephalomyelitis fo um 
ing childhood diseases or whether the tra sy” 
to the nervous system interferes with the i a 
chosocial (ego) development of the child. 
parently there is a hierarchy of ages ye ap’ 
the diseases are most deleterious and which #* 
Pears to coincide with the emergence of ce 
guage ideation at different levels of intellige" 
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alytic theory, the gradual shift 
ary to the secondary process in- 
Be control of impulse expres- 
a — of symbolization, fan- 
al a = immediate response on 
eat aa apaport’s [5] psychoana- 
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Orschac 
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ach ORE" 
Ween m, [6] implied a triadic relationship 


o Sa: 
BNitive fo motion perception, and 
et al, 27% Experiments by Singer, 
ioe ree ], testing hypotheses de- 
Nc theory, h and Wapner’s [11] sen- 
indie +o) = demonstrated one aspect 
ioe RUD, namely the vicarious 
Motion Bere motor inhibition and il- 
investigati ption. The purpose of the 
„Saton is to study the linkage be- 


notor fy: 
Inhibiti 

i pane 
Ocess, On and the inhibition of a 


S ar r 

or s sported indebted to VA trainees 

ee a a and Norris 
ce in this experiment, 

orothy Singer for their stimu- 

Suggestions, 


The Experiment 


Hypothesis. It is hypothesized that there 
is a direct relationship between motor inhibition 
and the inhibition of an association process. 
More specifically, it was predicted that Ss with 
greater ability to voluntarily inhibit motor ac- 
tivity would be able to inhibit learned associa- 
tions and produce new ones quicker than those 
less adept at inhibiting motor activity. 

Procedure. Eighty volunteer male and fe- 
male Ss were selected haphazardly from a uni-: 
versity population. They were requested t 
memorize a verbally presented list of ten pairs 
of words, to a criterion of one perfect repro- 
duction. Instructions were those used in the 
Wechsler Memory Scale [10]. The list of 
pairs was composed of stimulus words and the 
most common associations to them, as reported 
by Rapaport [4]. Association time was recorded 
to the nearest half second.” After the list was 
memorized, Ss were instructed to respond, up- 
on presentation of the stimulus word, with any 
word other than the learned paired associate. 
Responses were timed in the same manner as 
previously. The Ss were then instructed to write 
the phrase “New Jersey Chamber of Com- 
merce,” as slowly as possible, within the bound- 

„aries of parallel lines drawn one-half inch 
apart. They were reminded at 45-second inter- 
vals to write as slowly as possible. F. 

The motor inhibition task of enforced slow 
writing had been used successfully in prior ex- 
periments [2]. As far as the cognitive inhibi- 


2In the experimental procedure, the, dependent 
variable was measured prior to the independent 
variable, so that any errors in timing were not bi- 


ased errors. 5 
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tion task is concerned, it was reasoned that the 
production of new associations to words with 
already memorized associates would involve 
two processes: (a) inhibiting the learned ‘asso- 
ciate and (4) finding and reporting a different 
association. We shall refer to the latter process 
as associative facility. There was no apparent 
reason to believe it to be correlated with the 
ability to inhibit motor activity. The assump- 
tion was therefore made that associative facility 
would vary randomly among the experimental 
population, and that any obtained differences 
would be primarily due to systematic variation 
in the ability to inhibit associations. A partial 
test of this assumption was subsequently car- 
ried out, and is reported in the discussion of 
results. The Ss’ introspections about the cog- 
nitive inhibition task were solicited, and they 
uniformly reported either a conscious attempt 
to suppress an image of the learned associate, 
or, in the absence of an image, an awareness that 
there was a word to be avoided before an as- 
sociation could be produced. 


Results 
As can be seen in Table 1, the 
the poor motor inhibitors (i.e. 
MIT) is appreciably greater t 
gooa motor inhibitors (ie, 
MIT). This difference is statistically signifi- 
cant at p < .005, with a t of 3.38. Analysis of 
covariance reveals that this di 
be accounted for by the initi 
reaction time that exist betwee; 
The obtained F value is signi 
There was relatively litt] 


mean CIT of 
those with short 
han that of the 
those with long 


€ overlapping be- 
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tween the two groups. Seventy-seven per cent 
of Ss who were least able to inhibit motor ac- 
tivity took longer to inhibit associations than 
the mean time of the better motor sh 
On the other hand, only 12 per cent of the 
better motor inhibitors took longer than the 
mean time of the short MIT group to inhibit 
associations. 


Table 1 


E ime 
Mean Reaction Time and Cognitive Inhibition TiM 
of Long and Short Motor Inhibition Time Gr 5 


re group 
Measure Short MIT group Long MIT g! 
Mean reaction time, 1.0 0.9 
Paired associates? 
Mean CIT# 2.9 2.0 
ear e Te 
* Times are group means of individual Ss’ averag' 


action times for ten responses, 


Table 2 4 
Analysis of Covariance of Reaction Time and c 
nitive Inhibition Time of Long and Short Moto! 
Inhibition Time Groups 


Adjusted F 
Source df mean square A 
9 
Between groups 1 1278.680 9 
Within groups 77 128.455 
Discussion 


In view of the fact that the experimenti, 
sample was divided at the median, instea t 
representing extremes of` the population ong 
clear difference between the groups lends Sili 
confirmation to the hypothesis. The rent- 
voluntarily to inhibit motor activity app4 
ly goes hand in hand with the see ee 
inhibit associations as measured by the ou 
mental task. This finding, however, 15 ae tion 
ent upon the correctness of the assu™P se’ 
underlying the choice of the particular task Sr 
lected to measure thinking inhibition. 


Primary issue is the relegation of associat 
facility to a secondary role while consider 
inhibition as the primary determinant of ass 
tion times in the experimental task. - of 
In order to provide an experimental check s 
this reasoning, the cognitive inhibition task w 4 
repeated with 30 new Ss from the same 8 


cral population. These Ss were also require 
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give a single associati 
vids we e association to each of ten different 
inal a os the same source as the orig- 
ars, ae m . 
measure of ae response time was taken as a 
of the Ss h cme facility. A random half 
st began ad the pairs,first, while the remain- 
Vision rili the single-word associations. 
ae en Population into fast and slow 
5 eens Pilger a mean association time of 
and a mean the rapid thought inhibitors 
is differ: 1.6 seconds for the slow group. 
With a ¢ of L33 Is in the inconclusive range, 
Ut not wate G= -10). There is a positive, 
(tho = 32) pally significant, correlation 
The <) between the two variables. 
. Se results 
1S perh ults suggest that associative facility 
a factor than was originally 
‘ip a secondary one 
hi p onn account for very 
the Brome y significant difference be- 
: Sir rioj 2 
ite plausible — original experiment. It 
afans hat the ability to produce 
people rapidly is one of the means 
f inhibiting th able to accomplish the 
are ig neht, Those who have 
Th this extent better equipped 
ere are probabl < h pee 
7 at facilitate inhitee: y other abilities 
Th s ate inhibition. 
© findings š 
Si 8 of this 
ures ulation 
Ces re 
Condary levant ¢ 
Process c 


Is qu 


Investigation support 
a A car from diverse 
Tesults ited in ie soa p he 
inde so bear, atle the introduction. The 
We Standing of T ‘ast indirectly, upon our 
Emer’ Sensory. Rorschach MI responses. 
acti relationship erai theory suggests a vicari- 
cre Vity and ie perceptual and motor 
bein Motor €s one to predict that a de- 
tion tDCrease in theme Will be cemented 
l2. 5 “XPeriments b Percention of illusory mo- 
ERA confirm h y Singer, Meltzoff et al. 
of 5, and show Fi deduced from this 
Prod T activity ri the voluntary inhibition 
thos ction, The results in an increase in M 
Who are Bie also have demonstreted that 

Or a, *Tacteristic. a Productive of M responses 
i tivity, ` . ly better able to inhibit mo- 
Ormation thn study adds the addi- 
inhibitin nat those who are more 
ible to sake motor activity are also 
Oduce Uw It established associations 
t han It does not necessarily 
neasure of the capacity to 


ones, 


inhibit associations as well as motor activity, 
but these accumulated data would lead us to 
hypothesize that such a relationship exists. 

It is of interest to report the application of 
these experimental techniques to the study of 
the psychopathology of an individual clinical 
case. The patient was an intelligent manic 
whose behavior was characterized by motor 
and verbal hyperactivity and flights of ideas. 
He was examined while under treatment with 
the drug Tolserol, a muscular relaxant. He 
displayed no atypical motor behavior during the 
course of the examination. He gave neither M 
nor color responses on the Rorschach, could 
inhibit his motor activity for only 29 seconds 
(the mean of the total experimental population 
is 5 minutes, 48 seconds) ,* and was very poor 
at inhibiting associations with a mean time of 
6.4 seconds (the mean of the total experimen- 
tal population was 2.4 seconds).* It was con- 
cluded that despite the superficial effects of 
Tolserol, the patient was basically unable to in- 
hibit either motor activity or thoughts. About 
two weeks later, medication was discontinued, 
and he had a violent episode marked by unin- 
hibited verbalizations and extreme hyperac 
tivity necessitating his being placed in seclu- 
sion. 


Summary and Conclusions 


This study was designed to test the hypothe- 
sis of a direct relationship between motor in- 
hibition and the inhibition of a cognitive proc- 
ess. Eighty Ss were divided at the median into 
two groups on the basis of motor inhibition 
time, as measured by an enforced slow writing 
task. The difference between these two groups 
in cognitive inhibition time, as measured by Ss’ 
speed in inhibiting learned word association 
pairs and producing new associations to the 
stimulus words, was found to be statistically 
significant in the predicted direction. 

It is concluded that Ss with greater ability 
to voluntarily inhibit motor activity are able to 
inhibit learned associations and produce new 
ones more quickly than those less adept at in- 
hibiting motor activity. 

‘Received January 18, 1954. 


8These means are merely illustrative. They are 


not norms for clinical use. 
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The 

term “suicidal? A 
Patients den suicidal ” has been used to describe 
havior nonstrating heterogeneous kinds of 


Suicide t 
Severe 


ychological test data from 
als, as well as from those who 
uicide, in an attempt to devel- 
psychometric devices for the 
ae 
idal” patients [2, 3, 4, 5, 6]. 
consider whether or not such 
ae under the class term 
Psychological ti broad for effective use of 
e Patient who i in the study and detection of 
nly one a apt to attempt suicide. 
Problem ot ais ished study is relevant to the 
Broups by fe k ferentiating “suicidal” sub- 
oe sieht of psychological tests. Farbe- 
Sts of lies yzed MMPI records and other 
veterans Pane po of patients in a California 
me al sen ic hospital. Each group com 
o follows: (a) patients 
“A attempt within a relatively 
sele, 2de suicid res admission, (b) patients 
atte at random threats, and (c) patients 
Sor izes with no history of suicide 
pate: sig z thoughts (Control 
ma 'n the fir ere administered to each 
ata | be most i Ae after the attempt was 
Yik: $ : A 
hag the cutee Seon in the MMPI 
Suita MMP discrepancy in elevation 
The E Attempt Scale scores between the 
LAE Scor, and Suicide T 
dicates es for the Su ide Threat Groups. 
: a much gre uicide Threat Group in- 
Pro the ; ater severity of disturbance. 
© Psychiatri à j 
3 iieo service, VA Hospital, Min- 
inica] pi, thd the Divisions of Psychia- 
a, sychology of thi e 
M. Hal the University of 
s Ades isn 
Nesota, Minstrat 
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Moreover, the mean scores for the Suicide At- 
tempt and the Control Groups were not sig- 
nificantly different from each other. 

Farberow’s results from the use of other 
tests also emphasized that patients who have 
made a suicide attempt are considerably dis- 
similar from those expressing suicide threats. 
The purpose of this paper is to report an inves- 
tigation conducted in the Psychiatry Section 
of the Minneapolis Veterans Administration 
Hospital. This study consisted essentially of 
a replication of that portion of Farberow’s 
research employing the MMPI in the evalua- 
tion of “suicidal” patients. 


Selection and Description of Subjects 


From the summaries of all discharged male 
patients, two groups were selected, as follows: 
(a) patients who had made a suicide attempt 
shortly before admission to the hospital (Sui- 
cide Attempt Group), and (b) patients who 
expressed suicide thoughts (Suicide Thought 
Group). Although finer grouping of the 
cases was desired, it was not possible from the 
available file data. The MMPI for each of 
these patients was then obtained, but was in- 
cluded in the study only if it had been admin- 
istered within 15 days after admission and prior 
to electroshock or insulin therapy. A few addi- 
tional cases were acquired from more recent 
discharge summaries in order to obtain samp- 
les of 50 Suicide Attempt cases and of 100 

“Suicide Thought cases. 

A third sample consisting of a cross section 
of the psychiatric patient population was in- 
cluded in the study for comparison with the 
Suicide Attempt and the Suicide Thought 
Groups. In a previous unpublished study, 2 
sample of 250 psychiatric patients-in-gene 
‘had been selected. This group consisted essen- 
tially of every third patient admitted during 


© 
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a two-year period who had taken the MMPI. 
For the purposes of the present study, 39 cases 
were removed from this patient-in-general 
group because their discharge summaries indi- 
cated one or more attempts at, or thoughts of, 


suicide. These 211 cases will be referred to as 
the Control Group. 


For each group, data were obtained on diag- 
nosis, age, education, marital status, and in- 
telligence. Only summary statistics will be pre- 
sented because the major interest of this inves- 
tigation is in the comparison of personality test 
scores. Primary diagnoses of the Suicide At- 
tempt, the Suicide Thought, and the Control 
Groups are listed in Table 1. The groups do 
not differ significantly in broad diagnostic 
categories. However, among patients classi- 
fied as neurotic, those who have made suicide 
attempts or who have engaged in suicide think- 
ing are much more frequently diagnosed as de- 
pressive reaction than are patients-in-general, 
It is quite possible that the diagnosis of de- 
Pressive reaction is sometimes influenced by the 
evidence of suicidal behavior or mentation. 


Biographical data for the Suicide Attem 
bi pt, 
suicide Thought, and Control Groups, re- 
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Table 1 


z icide 
Primary Diagnoses of Patients in the bye 
Attempt, Suicide Thought, and Contro 


ent of 
Per cent of Per cent of Per c! 


trol 
Diagnosis Attempt Thought pa! 
Group Group 711) 
(N = 50) (N = 100) uz 
Depressive reaction 34 22 28 
Anxiety reaction 16 24 26 
Other neurotic 6 7 58 
Total neurotic 56 53 ii 
Paranoid schizophrenia 16 14 
Involutional 4 
melancholia 0 7 3 
Other psychotic 4 8 22 
Total psychotic 20 29 48 | 
Behavior disorder 18 15 3 | 
Organic 4 3 2 
No diagnosis 2 0 jon 
Total sample 100 100 


ho 
ried or widowed—68, 52, 58; percentage v i 
are divorced or separated—8, 18, 12; Po aA 
age in group below 110 IQ as roughly a 4h 
ed from the Shipley-Hartford test—26, a 
The median number of days age the 
pital admission and MMPI testing d Cow 
Suicide Attempt, Suicide Thought, an 


ela 
a ( trol Groups was 3, 4, and 3, respectiv mbet 
spectively, are as follows: median years of In the Suicide Attempt Group, the mod 
a 32, 32; median years of education— of patients making each of the aa slast 
» 12, 10; percentage of group who are mar- of attempt is as follows: Sedation—!85 
Table 2 
MMPI Scale Raw Scores for Suicide Thought, 
Suicide Attempt, and Control Groups F 
Mean raw score Variance raw score ratio | 
Scale Thought Attempt Control Thought Attempt Control 88 a 
7 3.63 3.28 376, 637 6.68 4.36 5.287 
p 9.63 8.68 7.40 40.83 39.62 27.72 3.07% | 
H 12.15 12.64 13.73 25.41 36.87 30.04 3.63", 
i 14.37 11.14 13.76 48.73 75.04 49.77 at, 
Hit SK 2068 17.74 20.88 41.86 45.47 42.47 16.16" 
H sae 28.14 28.60 40.71 44.28 49.93 3.6, 
Pd 29.76 26.66 28.47 41.76 53.70 43.58 5.93" 
hae 23.28 23.04 20.92 36.38 50.44 37.54 4.58" 
me eh 28.26 26.40 32.26 32.27 32.60 2.99 42 
Pa ie 26:08 25.33 28.51 29.83 29.60 3.65%, 
Pt oer 13.46 12.31 19.90 24.89 14.73 ott, j 
bios = 22.70 21.38 £97.99 151.89 115.74 915s 
Se a on sae 35.12 57.89 70.54 60.13 att 
Sc+ 10K Ssa 2240 20.22 180.43 222.80 150.78 7.73" 
ig -l pre 35.04 33.95 128.63 117.92 92.31 24 
i 19.58 17.76 23.80 33.56 28.33 2.514 
Ma+ 2K 2058 22.14 20.47 19.50 25.16 23.15 9.12 
s — a 32.00 32.10 118.09 13442 120.18 3 
* Significant at the .05 leval, “ 5 
** Significant at the -91 level, 
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Pa Pt 
Pa 


Se Ma 


FIK 41K #.:2K S; 


houghts (N=100) 
ttempts (N= 50) 
ontrols (N=2ll) 


T. Score 


Fig. 1.M 
"t Mean MM 5 
PI T-score profiles for Suicide Thought, Suicide Attempt, and Control Groups. 


4 REN cagbon monoxide—7 ; 
k ae = strangulation — 3; 
Ds ee a 
di . For 6 } Jumping in path of 
on ted: For 2 cases the method was not in- 
ne also ied cases listed only as “slashing,” 

Strangulåtion, and another gas. 


MMPI Results 


All 

calculati 

a ula 

nd the tions were made with raw scores, 


Score : 
a mean and variance of each 
satos ei Table 3 
es p eee g at Differences in Mean MMPI 
“cide Thought, Suicide Attempt, 


Sa ma Control Groups 
À t>T] 
P ienne eau emo Control> Control> 
E 32 'ontrol Attempt Thought 
Hs 2. 
6 . 
2 +s Hes 2.34 fii 
x 4.16 5.98 3.04 
2.67 á 
Pay 
Pa 4K 310 2.45 
Pi 265 2 
2.07 ji 
P: +y 2.04 09 
i ee i 
Bey 4.18 
ST LOK 4.11 
Aai i 
105 Oy atios of 19 x 
a +96, 
ang «001 leo and 3.29 are significant at 


S, respectively. 


MMPI scale for the Suicide Attempt, Suicide 
Thought, and Control Groups are presented 
in Table 2 for reference purposes. The Cannot® 
Say score was zero in most cases, and is there- 
fore not considered further. Mean T scores 
based on the raw scores are shown in Figure 1. 
In order to determine the significance of the 
differences between means, an analysis of vari- 
ance test was made for each scale. The Bartlett 
test indicated no significant difference in the 
variances for any scale. The F ratio for each 
analysis of variance is listed in the last column 
of Table 2, from which it can be seen that al- 
most every scale differentiates in some manner 
between the groups. For each scale with a sig- 
nificant F ratio the significance of the difference 
between the means of each pair of the three 
groups was computed by the ż test. Only dif- 
ferences found to be significant at or beyond the 
.05 level are listed in Table 3. 

On every scale in Table 3, except for K, the 
Suicide Thought Group is significantly higher 
in mean score than either the Suicide Attempt 
or the Control Group. The Suicide Attempt 
Group is significantly higher than the Control 
Group on the Pd and Pd + 4K scales, and 
significantly lower on Hs and Hs + 5K. 
These findings indicate that, as a group, pa- 
tients with thoughts of suidide are much more 
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severely disturbed than either patients who 
have made a suicide attempt or patients-in- 
general, and that patients in the latter two 
Categories are similar to each other. One might 
hypothesize that for many individuals, a reduc- 
tion in the degree of psychiatric disturbance 
follows a suicide attempt. However, this 
hypothesis can be evaluated only if one has test 
data for such individuals both before and after 
a suicide attempt. 

The results of this study are quite consistent 
with those of Farberow [1]. Both studies in- 
dicate that patients who have attempted suicide 
are markedly different from those who threat- 
€n or contemplate suicide. In any investigation 
of the “suicidal” patient, it appears probable 
that the most meaningful results would be ob- 
tained from an analysis of groups which are as 
finely delineated as possible, 

Summary 

Psychological test data from patients demon- 

Strating various kinds of “suicidal” behavior 


are usually grouped together by investigators 
who are attempti i 


veteran psychiatric Patients were ana- 


(a) patients 
shortly be- 
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fore admission (Suicide Attempt Group), O) 
patients who expressed thoughte of ee, 
(Suicide Thought Group), and (c) pe e 
selected at random, with no evidence of a 
attempts, threats, or thoughts (Com Fs 
Group). The two studies closely agree aa 
dicating that groups of patients who expres F 
cide mentation and threats are much me 
verely disturbed than either patients who al 
made a suicide attempt or patients-in-ge" ; 
and that patients in the latter two cater A 
similar to each other. It may be conclude ing 
in any investigation of suicide, most meran fe 
ful results might be obtained if data for a si 
duals with various kinds of “suicidal” beba 
are differentially classified. 

Received December 7, 1953. 
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to treatment 


nimous agreement among pro- 
Ts in the field of psychiatry that 
ae begins after the develop- 
a Iness, the greater the chances 
a aly and Hoch put it, 
a ant factor in evaluating 
tay is the duration of illness prior 
all tates, i a agreement exists among 
ship between ms there is an inverse relation- 
aes El, 6 a duration of illness and re- 
Was t x 
e Proana n Purpose of this study to evaluate 
hess by studi significance of duration of ill- 
illness q tins a 5 relationship to outcome of 
bo n parce wy also signi- 
» had been con- 


Method 


The dat 
a in ahh 
from hee hn this study were obtained 
— Institute admitted to Western Psychi- 
of Pit and Clinic (WPIC), Univer- 
urgh, between November 1942 


uly 19 1 
S SO. The 
Ons aq These cases included all per- 


y mitteq who 

n n 15 

A © mental 

S, and no 
his 

0} Sam 


in z umy 

Were 8 their derea" as of one year fol- 
Psyop? 8ed on the € from WPIC. Patients 
imp tatrist p € basis of social workers’ or 
leve ved if t “Ports. ‘They were considered 
Work Comparabh. Were out and working on a 
judg = Prior E Si that on which they had 
d nimproy ecoming ill, and they were 

ed if still in a hospital, or 


Sean € th 
Teh we Uni 

Wa lersii 
done, ty of Pittsburgh when this re- 


if they were at home being cared for. 

Duration was measured in months; the time 
that elapsed between the first time the patient 
or relatives sought medical help for the patient 
and the time he was admitted to the hospital 
for treatment was considered the duration. It 
is admitted that this allows for a considerable 
period of time for the patient to have been ill 
before it was realized by his relatives, particu- 
larly in the case of those whose illnesses devel- 
oped insidiously, but this criterion was used 
because it was felt to be the most reliable for 
the purpose of this study. 

The relationship between outcome of illness 
and 21 variables was determined. These 21 
variables were: sex, age, marital status, nation-® 
ality, occupation, economic level, body type, 
education, intellectual status, affective expres- 
sion, orientation, direction of aggression, diag- 
nosis, age at onset of illness, duration of illness, 
length of hospitalization, status upon discharge, 
precipitating stress, treatment, religion, and 
type of onset. It was found that 11 of these 
variables were related to outcome at the .01 


Table 1 


Statistics of the Total Groups and 


Summary 
Controlled Sample Group on Duration of Illness 
Total Controlled 
Statistic group sample group 
N 486 180 
Mean months 
Improved 21.70 34.08 
Unimproved 38.59 23.18 y 
Standard deviation 
Improved 22.74 37.12 
Unimproved 27.90 20.59 
ti 7.318" 2.45" 
risk 33** —14 


f Between improved and unimproved within group: 
+ Between duration and outcome. 

= Significant at .05 level. 

++ Significant at .01 level. r 
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level of confidence. These 11 were: marital 
status, affective expression, orientation, direc- 
tion of aggression, diagnosis, type of onset, du- 
ration of illness, hospital stay, status on dis- 
charge, precipitating Stress, and treatment. The 
relationship between these variables and out- 
come is discussed more fully in a previous 
paper [2]. 

The correlation between duration of illness 
and outcome for this total sample of 486 was 
38. This is presented in Table 1. It will be 
noted that the unimproved group had a mean 
duration of illness of 38.59 months, or 17 
months more than the mean for the improved 
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tween the improved and unimproved gro 
any of the variables other than duration a 
were significantly related to outcome of illn o 
There were 180 cases remaining, 90 impro 
and 90 unimproved, when this matching Ke 
been completed. The differences between i 
controlled sample groups on the significai i 
iables are presented in Table 3. A chec 


. ween 
vealed that there were no differences bet 
i 


Table 3 | 


rou 
Differences between the Controlled Sample Gro"! 
in the Significant Variables 


° ic? 
group. Variable Statist i 
The relationships between duration of ill- Diagnosis ai EE o 
ness and the other variables that were signifi- Marital status hi square =) 
R rientation and 
cantly related to outcome of illness are con- Present chi square = g 
Table 2 Affect E 
Relationship between Duration of Illness tang of aggression t=" 
and Other Significant Variables yP non onset pu 
Hospital stay 1 82 
Variable Chi square > Precipitating stress 
Affective expression 26.9 .01 * All below .10 level of confidence. ifi 
Orientation š ign 
Direction of aggression or T the groups on any of the variables not ening 
@ Diagnosis 113 ‘os cantly related to outcome. After this mé auf 
Type of onset 79.8 01 Was completed, the relationship Darwen the 
Precipitating stress 19.3 01 tion of illness and outcome of illness | 
reatment 23.5 01 controlled groups was determined. l 
Marital status 5.2 30 | 


tained in Table 2, Duration was related to five 
of the variables (affective expression, direction 
of aggression, type of onset, precipitating stress, 
and treatment) at the -01 level. A long dura- 
tion of illness tended to be associated with an 
appropriate affect or an absence of affect, 


Results and Discussion ampl 
A comparison of the controlled 4 uP , 
groups revealed that the unimprove han ce 
had a lower mean duration of illness go was 
improved group, and that this diers corte" | 
significant at the .05 level. The biseria 0 the 
lation coefficient, which had been -38 lh 
total group of 486, was reduced to which 
(These results are contained in Table tend * 
was presented earlier.) These figures trol in 
give the impression that under the a ration 
Procedure used in this study, a longer i ow 
is a better sign than a short duration. avid 
ever, a comparison of the aera uni” 
various durations for the improved an cs 
Proved groups, as presented in Table an che 
veals that there 5s little difference betw" at, 
unimproved and improved groups 0n E af 
of patients falling into the various catei of 
duration. In the process of eliminating i ov? | 
fect of the other variables, the improve eo) | 
was left with several patients with ext! | 
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Table 4 


Ditte 
isttibutiom of Controlled Sample Groups 
on Duration of Illness 


Months 
duration improved Unimproved 
o group g 
Under 3; = group 
6-11 2 1 
12-23 12 17 
Jass 18 11 
Over 36 13 20 
. Chi square 35 30 
4.40 


l ; 
ong duration of 
or the group. 

© net result 


illness, thus raising the mean 


elimination of tl would seem to be that the 
Slenificantly R he effect of the other variables 
the Telationshi oe to outcome also eliminated 
outcome E obtaining between duration 

: ind it would appear that the im- 

‘ration as a prognostic sign is de- 


chief] : 
Variables og from its relationship to other 


< €S Of more b 
antly re] 
hat the gs 


H 
t rather it is the mental illness is concerned, 
ia Continue un bel Processes that are allowed 
ime that are = ecked during this passage of 

importance to the outcome of 


Summary 


Urpose : 
‘eed of this study to deter- 
1p between duration of men- 
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tal illness and the outcome of illness when the 
effect of other variables, significantly related to 
outcome, had been controlled. 

A sample of 486 patients was used. The re- 
lationship between outcome of illness and 21 
variables was determined. Then the group was 
divided into an improved and an unimproved 
group, and cases dropped from each of the 
groups until there were no significant differ- 
ences between the groups on any of the vari- 
ables other than duration of illness. 

It was found that after this controlling was 
completed there were no significant differences 
between the groups on duration of illness. This 
result was interpreted as indicating that the 
prognostic importance of duration of illness 
derived from its relationship to other variables 
related to the basic disease process, that the 
mere passage of time presaged neither good nor 
ill for mental illness, but rather, that it was 
the processes allowed to progress unchecked 
during this period that were of prognostic im- 
portance in mental illness. 
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Rigidity in Conceptual Thinking in Exogenous 
and Endogenous Mentally Retarded Children — 
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It is noted occasionally by clinicians that ex- 
ogenous mentally retarded children, as com- 
pared with endogenous, are significantly less 
able to perform such memory-for-designs tests 
as that found at year IX on the Revised Stan- 
ford-Binet Intelligence Scale. At least one in- 
vestigator [4] has suggested that their inferior 
performance is not due to faulty memory, as is 
frequently supposed, but to other factors. In an 
earlier paper [15] the author attempted to 
demonstrate that the unusual visual percep- 
tion of brain-injured subjects is one factor ac- 


l but rather of mis ercep- 
tion of the stimulus figures. pai 

Using the Ellis Visual Designs Test [21] 
as a means of quantifying a child’s drawing 
ability, the author noted earlier [14] that some 
mentally retarded children exhibited di 
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In accordance with Goldstein [5]; well 
[20], and others, rigidity in the pee t 
is defined as the tendency of an indivi ion i 
resist change maladaptively. Persevera 
regarded as one type of rigid response “a | 
peats itself maladaptively. Flexibility e 
garded as the capacity of an individual E 
mental sets and corresponding respons? j 
Propriately as these are required by chang 
the stimulus situation. 

A number of investigators have ee 
dence that the brain-injured are charac i 
by rigidity. In 1928 Cameron [2] showed 
brain-operated rats are less able than 
animals to break a habit and form a pale 
Maier [16] has demonstrated that be. 
Tats tend to perseverate, that is, to eP 
Same errors in successive trials. Gold re 
7], in more recent studies with brain ity 8 4 
and normal adults, concluded that rig! n jr” 
general pathological trait that is pres 
spective of the focus of legion. ive char 

Rigidity is not, however, an exclusiva jem" | 
acteristic of the brain-injured. It has De ida 
onstrated that mentally retarded i? w righ 
whose deficiency is endogenous also sho iditY 2) 
ity. Werner [19] refers to their mE o th 
subnormal, in comparison with tha nor 
brain-injured child which is termed #7 sub 
rigidity. One example of a study m4 il; wh? 
normal rigidity is that of Lewin yi no 
found that endogenous as compared i igb” 
mal subjects displayed a significant Y prat” 
degree of rigidity. The investigations O irern” 

h 


ae 


stein 
-inju 


and -Werner [18] and Carrison and a] 
[3], dealing with abnormal rigidi a 
shown that exogenous as compared ver 


fi se 
dogenous defective children exhibit pers” prom 


tion and a general difficulty in shi fine Fi 
one task to another. yds 


è : o 
any research workers, including G 
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and P 
Doen m, Weigl [19], Kasanin and 
deid on E 4], and Werner [19, 20], have 
eer a Pus an attempt to measure the 
ee he i sence of rigidity. After explor- 
ae F pp icability of these tests on small 
thor a aly defective children, the au- 
instrument ae generally inappropriate. The 
ent study y nally selected for use in the pres- 
Card-sortj vas a modification of a Weigl-type 
Ing test first described by Berg [1],and 


ater by G 
4 Tanta 5 i 
of Wisconsin, and Berg [9], at the University 


The test is an objective tech- 
2 Suring human abstraction and 
is claimed by its authors to yield 


ative m 
1 ceasuri = 
ng and reasoning es of these aspects of think- 


nique for mea 
shift of sak 


s P . 
Problem, G lie Investigation 


3 l : 
Vestigate the } 1e purpose of this study is to in- 
Pared with er : cna that exogenous as com- 
dren show isin AR mentally retarded chil- 
ing, ater rigidity in conceptual think- 


Subjects 
Su ? — Soups of,mentally defective 
scribed in ey and endogenous, more ful- 
sti Rosen ae Previous publication [15], 
| ttionalized a total population of 2,000 
+d patients. The 15 exogenous 
all 6f the available patients 


e 
wh < included 
15 atisfied the rigid Teer, 

selection criteria. The 


Ogeno 
Senous sub; j 
Paired ag bjects, six boys and nine girls, 


as possible with the ex- 
the p echce, Intelli $x, chronological age, and 
*Vised Stang =e Was measured using 
Subjem = The "th Biet Intelligence Scale, 
i “ied between E were composed of 

by a Ween 40 and ane of 10 and 20 with 
the do Subjects were selected 

: . The edical staff, a geneticist, 
(a) Jury in aw Presence or absence of 
sibject was established 
hi ie history material 
Cal examinations of the 


Senn. 
‘amination 


neurolog 
Mselves 


St usag -€ Modi : A 

Pack sé Used in È fied Wisconsin card-sort- 
Š i Present study consists of a 

Size 4 e cards made f p 
tO Bach Ţ_ PProxim adv of white card- 
teal l card cont ately 314 X 5 inches in 
pares x rer from one to three iden- 
diamon š ingle color. Three kinds of 
olor areo ii, and triangles—and 
fen, blue, and red—are 


T re 
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used. A single card might have one green dia- 
mond, or two blue squares, or three red tri- 
angles, or any such combination. Thus, the 
cards may be sorted according to any one of 
three different principles (a) the color, (4) the 
form, or (c) the number of figures on each 
card. In addition to the 27 response cards which 
are sorted by each subject, there are three stim- 
ulus cards which are placed on the table by the 
examiner as guides for sorting. The three stim- 
ulus cards are always placed in the following 
order: the card showing one green diamond; 
the card showing two blue squares; and the 
card showing three red triangles. 

When the cards are first presented to the subject 
for sorting, they are arranged in a standard order, 
but for any subsequent sortings the cards are simply 
shuffled. Sorting in terms of color is the principle 
first accepted as correct. The subject, of course, re- 
ceives no instructions to this effect. He is simply 
told that his response is incorrect when he is not 
placing the response cards in front of the stimulus 
cards according to color. After a subject has sorted 
five successive cards according to the principle of 
color it is assumed that he has grasped the principle 
that the examiner accepts as correct and is using it 
in his sorting. At this point the examiner calls such 
sortings of the cards incorrect and continues to do 
so until the subject next learns to sort them accord- 
ing to either the form or the shape of the designs 
on the cards. The same general procedure is re- 
peated until the three sorting principles of color, 
form, and number have been successfully grasped 
or until the pack of response cards has been sorted 
completely six times. The following instructions are 
given to each subject: 

“J want you to pu 
front of one of the three c: 


aminer demonstrates). Lay 1 
a time. As you can see, the cards differ in three 


ways: in the color of the spots on each card; in the 
number of spots on each card; and in the shape of 
the spots on each card. Put each card down where 
you think it should go and I will tell you when you 
are right and when you are wrong. Remember that 
there are three ways to sort the cards. Don’t take 
too long but get as many right as you can.” 
Scoring procedure. Rigid behavior on the 
card-sorting test is scored according to three 
different criteria: $ 
1. Perseverative responses: A perseverative 
response occurs when a card is sorted in terms 
of a principal previously accepted as correct 
(e-g., a card sorted according to the principle of 
color when it is supposed to be sorted according 


to the principle of form). 
2. The total number of ca:ds so 


t these cards on the table in 
ards already there (ex- 
the cards down one at 


rted (correct- 
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ly or incorrectly) before each of the three 
sorting principles is grasped. 

3. The time required to grasp and apply each 
new sorting principle. 


Results and Discussion 


The exogenous as compared with the endog- 
enous mentally retarded subjects showed, on 
the average, significantly more rigid behavior 
on the modified Wisconsin card-sorting test. 
As indicated in Table 1, rigidity was apparent 
not only in the subjects’ total number of per- 
Severative responses, but also in the other two 
measures of sorting efficiency, that is, in the 
total number of cards sorted and in the time 
needed to grasp and apply the three sorting 


principles. 
Table 1 


Group Difference in Total Rigidity Scores 
on the Modified Wisconsin Card-Sorting Test 


Endogenous Exogenous 
subjects subjects rt 
(N=15) (N=15) 


Marking criteria 


Color 
D Perseverative score 0 0 

Number of 

cards sorted 198 311 1.56 
Time in seconds 1544 2917 1.80 
Form 

Perseveratiye score 23 160 2.55* 
Number of 

cards sorted 210 580 3.70** 
Time in seconds 1551 3971 2.95% 
Number 

Perseverative score 52 248 4.91%% 
Number of 

cards sorted 372 915 4.719* 
Time in seconds 2719 5993 2.91* 
Total scores 

Perseveratiye score 75 408 5.38%# 
Number of 

cards sorted 780 1793 6.17#* 
Time in seconds S715 13035 4.31%% 

+ The t rat 


f ios were calculated using Wo 

tion [13] of the usual formula for small mate 
2 Significant at 59% level “of confidence. 
“* Significant at the 1% level, 


ver's varia- 
ateched groups. 


number of errors m ds are sorted 
in terms of the principle previously accepted as 
correct. This interpretation of perseveratizn 
agrees with that of Werner [19], who uses 
the term to indicate the persistent repetition or 
continuation of an ‘activity once begun. A di- 
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. of 
rect comparison of the perseveration sor 
the two etiological groups shoved yal | 
enous group mean to be 5.0 (range hi 
and the exogenous group mean er 
(range 2 — 59). In addition to the di bell 
between the scores of the two grou ad 
statistically significant at the one per Ce! atd 
of confidence, there was an apparent 
score. All of the endogenous, but only th 
the exogenous, subjects had a score M vant 
less. The group differences are presente ufal 
cally in Figure 1. As was expected, i zend 
etiological difference in favor of the en ve: tai 
mentally retarded subjects appears to 


Twa 


E 
` 
o 
! 
i 
° 
“ 
\ 


o ENDOGENOUS 
e--@ ExocEnous 


PERCENTAGE OF CUMULATIVE FREQUENCY 


o ' 30 88 
° 5 10 15 20 25 30 35 40 49 o 
PERSEVERATION Scores «nS 
j : distribution’ ye 
Fig. 1. Cumulative percentage ex 


5 an 
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ome sae eater for ©)" ge 
principles were significantly gred 


ly 

nenta” ef 
ogenous than for the endogenous rant grea 
fective subjects. The longer time a” ed ”, 


number of responses required is con cone ! 
the author to be the result of a heir 
subjects’ reduced ability to shift i a 
readily from one sorting principle i” the fi 
In comparing the scores achieved re sty | 
groups of subjects on the ar g 
was found that both groups enun mi i i 
er difficulty as the test progressed. W ia s 
already been shown in Table 1 that joge" 
cnous, as compared with the vse Lee 
mentally retarded subjects showed pit sf 
behavior in the test as a whole, the 8? 
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phen sea in that they both found sort- 
eult E Principle of number more 
of form. Thi arting according to the principle 
to the fact a is probably due, in part at least, 
number of pri at E pi = proportional to the 
earned to fern a by which the subjects have 
Present stud r the cards. The results of the 
breder’s [104 however, tend to support Heid- 
subjects, whi get performed with normal 
Cepts, R o ound that of the three con- 
2 sorting, T] was the last concept to determine 
Ment with E present study is also in agree- 
den [17 ie ; Investigations reported by Sen- 
i twe perceptions of the congenitally 
eration. He indicates that the 
or persistently dominates form 
Months after a of such patients. Eleven 
fen learned enon the color names that had 
ad been leatn i etained, but the little that 
of form was forgotten. 


ind after op 
joncent of col 
n the first y 


compari 
investigate of the rigidity scores in this 
tained in n with the perception scores ob- 
Significant + Se mg study [15] denoted no 
Pro itine ationship between these factors. 
Broup + pent Correlations (endogenous 
not significant Ses group — .10) were 
k his would tend or either etiological group. 
ty » as Measured T indicate that visual percep- 
hi ely į epende y Lissajou’s figures, is rela- 
AUS set ent of a subject’s ability to shift 


rom 
In, one 
8 task, task to another on a card-sort- 
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Tevio . 

ca us j Boa 

Pa hat exopeetisitions [5, 14] have indi- 
° Signi us n ildrè 

Sio nificant] nentally retarded childrén 


fro.’ Stiolog > = able than those of endog- 
copy, Th a Teproduce visual designs 

per. Provided wi, revious paper [15] the au- 
face Ption of the ence that the unusual visual 
*Ccountin oe defectives was one 

ate, The & for their poor drawing per- 
tiv, 2 investigate dre of the present study 
Visuay x ity of the T hypothesis that the rela- 
esigns fron rain-injured to reprocuce 
Mite o Eetika de dat cc mera to ta- 
g. ue to rigidity in conceptual 
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enous and endogenous mentally retarded chil- 
dren. The subjects from the two groups were 
paired on the basis of sex, chronological age, 
and intelligence. 

It was demonstrated that the brain-injured 
are significantly more rigid in conceptual think- 
ing as shown by their greater tendency to per- 
severate on a card-sorting task. The exogenous 
child is indeed less able to shift his mental set 
from a sorting principle such as color to another 
such as form or number. Such findings warrant 
the conclusion that the relatively poor drawing 
performance of exogenous defectives on such 
memory-for-designs tests as that found at year 
IX on the Binet are not due to faulty memory 
but to such factors as perseveration and rigidity 
in conceptual thinking. 
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_ The di : 

cman ee of brain injury is of major 
for this q, UP"! recently the responsibility 
Cal Profession, T rested solely with the medi- 
chological find; oday it is recognized that psy- 
liagnosis alor ngs may contribute to the final 
tion and cach | with the neurological examina- 
cephalogram omy tests as the electroen- 
important fo, Ithough a correct diagnosis is 
Sreater Sos Mature individuals, it is of even 
Cause of the al aR young children be- 
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loping organis brain injury on the de- 
te much of m [4]. Brain-injured adults re- 

ough what they have learned even 
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new skills is impaired. 
serious, however, for 
ned cerebral insult be- 
mally learned. If a cor- 
mie de, they may not receive 
mil which they need in or- 
especiali y expected skills. Methods 
necessary fy, y designed to teach them 
ñ ena o as reading and arith- 
amen ‘mentia is m S fta dingnosisiof pri 
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Renon ntly p wa an Jury, these children are 
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Tin, or eve i cae 
fe [5], n rudimentary academic 
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grees of ability [2]. The fact that test items in 
both verbal and performance areas are admin- 
istered to children and infants as young as four 
weeks on the Gesell Developmental Schedules 
and at two months on the Cattell Infant Tests 
lends weight to the concept of differential abil- 
ities in the young child [1, 9]. 

On the basis of previous research with older 
children there is reason to suspect that young 
brain-injured children have difficulty in con- 
ceptual thinking, in visual-motor and percep- 
tual judgment, and there is also the possibility 
of more general mental retardation [7, 13, 14, 
17, 21]. Whether or not intellectual impair- 
ment follows a brain injury depends on the 
area of the brain affected. If the lesion is in the 
cerebral cortex, intellectual impairment or “def- 
icit” is a definite possibility although even here 
not an inevitable consequence [18]. Literally, 
any case of feeblemindedness might be con- 
sidered as possibly due to birth lesion when one 
considers the whole process of fetal develop- 
ment and the difficulties of childbirth. 


Method 


The instrument chosen in this investigation 
to test varying degrees of ability was the Mer- 
rill-Palmer Scale of Mental Tests [19]. It 
was selected primarily because it consists of a 
battery of verbal and performance tests that 
permits scoring for different degrees of ability 
through the preschool years. In addition, it has 
strong appeal for young children and very few 
resist “playing the games.” Motivation is an 
important factor since cooperation is frequently 
difficult to obtain in brain-injured children on 
tests without intrinsic appeal. In fact, electro- 
encephalograms are often reported to be un- 
satisfactory in these children because of lack 


cf cooperation. f a 
It is hypothesized that young children wi 
brain injury will show decreased efficiency 0n 
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tests involving conceptual thinking, visual-mo- 
tor skill, and perceptual judgment. Specifically, 
it is expected that the brain-injured group 
should show significantly lower means on the 
selected Merrill-Palmer tests that purport to 
measure these abilities than the control group. 
A brain-injured child in this study is defined 
as one who has suffered a brain lesion due to 
infection or injury occurring before, during, or 
after birth. Conceptual thinking is conceived as 
the ability to form a concept, to classify ac- 
cording to a common factor. Visual-motor skill 
is dependent upon eye-hand coordination, finger 
dexterity, speed of reaction time, spatial evalu- 
ation, and visual memory. Perceptual judg- 
ment implies the discriminative observation of 
differences, relationships, and organizations, 


injured group of 100 children and two non- 
brain-injured groups consisting of 100 behav- 
home children to 
and the Revised 


ery school, kindergarten 
but the foster-home 


to these educati. 


low intelligen 
would probably haye been elimi 


onal groups, 
ce quotients 
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r č 
age at least 30 months on the Merrill Pat 
[20]. These limitations stem fram the s 5 
of Merrill-Palmer tests and a iN mes 
dominantly preschool population. T A 
Stanford-Binet IQ fer the brain-injure | 
foster-home children was found to Pe feu 
for the behavior-problem group 89- he thë 
no attempt had been made to match ‘oul 
groups for sex, the brain-injured were he no 
have a one-to-one ratio, while both on id, 
brain-injured groups had a higher ae 
of boys. None of the children had : if 
auditory impairments, nor was there 
ence in the socioeconomic backgrounds: bi 

wersi 108 
injury, 5; meningitis or encephalitis, eae: i 
of the brain, 23; tumor of the brain, 4 il; hyde 
petit mal epilepsy, 16; cortical Sai 1 
cephalus, 9; brain-injury etiology ae halos 
electroencephalograms and pneumoence? i st 
Were abnormal, The behavior-problem ninini" 
home children are known as nonrbre” i 
groups because their developmental Pant 
neurological examinations gave no eV! 
lesion of the central nervous system. 


The etiologies in the exogenous group 


ries 


. ent, f 
The tests selected were the Action G Sian” 
Buttons, the Copying a Circle, Cross, Pink TOA 
Seguin Formboard, the Pyramids, m zzles pec? 
the Mare and Foal, and the Kistar | T provi fr 
they tap a variety of abilit'es as wel “childse? 
varying degrees of proficiency among minister? 
30 to 77 months. The tests usually a hey are ap 
low 30 months were omitted because t for exam pe 
on the all-or-none principle of SOFIE jaor yof 
the child can either cut with a pair of SC 


s7 ps 
cannot; he can either identify himself * a 
or he cannot, si 
vito. in the aol 
An analysis of the abilities 1n tep 99. el 
almer was made as a preliminary ppi hio / 
the abilities involved in each test W€? “yh A 


$ s data je 
Prior to the analysis of the relevant J 


jnic® 4) 
Competent psychologists who had i and n 
perience with the Merrill-Palmer S ue É | 
taught and demonstrated its teeb to Gr 
uate students and externs were elos e jute j 
on the writer’s analysis of abilities- he abil y 
were sent the writer’s analysis of t s togi if 
involved in the Merrill-Palmer iris AM 
with a list of Gefinitions for the abi ing of 
Combined efforts resulted in a grouP! í tety 
tests in terms of the abilities in ave | 
they related to the hypothesis under pink 
tion. For example, under conceptu@ his ab 
was listed the test which involves t 
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ET 3 mider visual-motor skill those tests 

action R y hee evaluation, speed of re- 

eke. i ra visual memory ; and under 

a Judgment tests which are predomi- 
Y dependent upon this ability. 


Results 


Th : 
of the t Mervill-Palmer mean scores for each 
to 4.8, where neo groups ranged from 3.0 
to 7.0. Whe dere is a possible range from 0 
the differences the ¢ test of the significance of 
Brouns, for nae peters the means of the three 
ound that no os subtest, was computed, it was 
the .05 lent was significantly different at 
Was applied re ar instances. When the ¢ test 
“ans within k differences between subtest 
ound to reach ach group, no one test was 
all Seven ates Significance at the .05 level in 
aceented in a null hypothesis 
erences among t he criterion, and 
sts in any g the three groups and be- 
» be attributed Of khe aga must 
2 tests E to chance. Table 1 
< crrill-Palmer ween the means of the 
Stic groups tests for each pair of di- 
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easuring « ciency on tests presum- 
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which nc than specific [8]. Other 

rar significant differences 
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possible that the Merrill-Palmer as a measur- 
ing device is not a sensitive enough instrument 
to differentiate degrees of conceptual thinking, 
spatial evaluation, and perceptual judgment 
compared to those tests which have been spe- 
cifically designed for differential diagnosis. 
The fact that little relationship was found be- 
tween Stanford-Binet IQ’s and Merrill-Pal- 
mer test scores tends to support this interpreta- 
tion. The present research is in line with the 
recent attempts to explore the contributions of 
intelligence tests to neuropsychiatric diagnosis. 
Since these tests were designed to measure 
global intelligence and are based on theory di- 
rected toward that end, it should be no dis- 
paragement of the Merrill-Palmer that it does 
not perform a function foreign to its basic pre- 


mise [15]. 
Summary 


This study investigated the ability of se- 
lected subtests of the Merrill-Palmer scale to 
differentiate between brain-injured and non- 
brain-injured children, three to seven years of 
age. The experimental group of 100 brain-in- 
jured children was compared to two control 
groups of 100 behavior-problem children and 
100 foster-home children. Analyses were made 
by ż tests of the differences of mean subtest 
scores within each group. Although a few 
scattered ¢ tests showed statistical significance, 
no test pattern emerged that validly differen- 
tiated the brain-injured from the other groups. 
The null hypothesis must be accepted. It is con- 
cluded that subtests of the Merrill-Palmer 
scale are not useful for the differential diag- 
nosis of brain-injured children from behavior- 
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t Tests betw Table 1 ; 
een Means of Fight Merrill-Palmer Tests for Each Pair of Diagnostic Groups 
G Tests 
5 a 
fia Picture Z Action Pink Mare Circle, 
Braj Seguin Puzzles Buttons Agent Tower & Pyramids Cross, 
behay pitted ys Foal Star, 
Ben, ‘Or Proble, > 
a lem . 
foster p, Problem 1.27 1.66 .52 1.76 1.84 90 1.74 92 
. tom, 
raj arpe e 
foster pared vg 2.21% — 2,708* 23 3.02%" 1.49 83 1.49 1.60 
0] 
e 
i -88 1.01 78 5.06** «30 .06 22 58 


Signi 
ty Syeificant a 


Ìgnificant a -05 level of confidence (1.96). 


-01 level of confidence (2.576). 
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Se ft : 
x Differences on the Revised Beta Examination 


‘ George Lavos 
Michigan School for the Deaf 


The : 

u ii Beta Examination is a non- 
ability” f est measuring “general intellectual 
U, p. 211 those 16 years of age and older 
appear in T reports of its use with the deaf 
able for ig literature although it is adapt- 
format, and with the deaf in administration 

nonlanguage response. , 


The Problem 


“arp Examination is provided 
lent ni white male adults. These 
ately | o that they would represent 
y educational n the normative population 
t white and socioeconomic status of the 
though the as in the 1940 U.S. census. Al- 
ti n, the andardization èroup is limited to 
ton has beer al states that “the Examina- 
* en for hee for testing women as well 
Mead Indicatin years and no report has been 
Ted for th 8 that different norms were re- 
€ different sexes” [1, p. 6]. 


e 
Men __ “SSumpti 
on 
that the norms based on 


he Revised 
Norms b 

a 

5 en Were $ 
YOPorti 
1 

the Or 


tes aPpropri. 
ment Cfore et for women should be 
Droba. f° deaf of the examination is recom- 
ther, Mis, then he and older girls. The 
tiene i = en used with deaf youths is 
that . “Sed on th nce in the intelligence quo- 
the „ Mot be Sa Beta Examination 
ation ? uted to chance sampling in 
apie = Method 
3 €s of rds of 188 deaf P 
Vailaby.° and 19 eaf pupils, between the 
at the time of testing, were 


ne ave 

the test age age at the time of ad- 
sq} third testi was 17-3, The pupils were 
Shoo] ng since the Beta test was 


grou 

` Pt ince t 

Phere w “St of intelligence used in the 
Aly Wer Ich th 3 

ag en da o Gata wete obtained. 
pa S and 109 boys in the group. 


ad ar] $ 
Th Severe Y enrolled pupils in the school 
inteligen = losses. 
nce quotients for the total 
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group ranged from 62 to 128. These quotients 
were calculated according to the Lindner-Gur- 
vitz procedure recommended for use with the 
Beta test. ; 

In order to find out whether there is a sex 
difference on the Beta, it is necessary to ascer- 
tain whether the performance of the two sexes 
is the same on similar tests. Since the Beta was 
the third of a series of tests of nonlanguage in- 
telligence used with the subjects of the study, 
results of the first two tests could be used to 
assess the possibility that a sex difference al- 
ready exists in the group. The critical ratio of 
the difference between the means of the quo- 
tients for boys and girls on the first of the two 
tests given earlier, the Chicago Non-Verbal 
Examination, was 1.44. The critical ratio for 
the mean quotients from the second test, the 
Pintner Non-Language Test of Mental Abil- 
ity, Intermediate Series, was .005. Both ratios 
indicated that no sex differences exist on the 
Chicago and the Pintner tests that cannot be 
attributed to chance factors. 


Results 
a intelligence quotient of the 
girls (94.4) was lower than that of the boys 
(103.0). The critical ratio of the difference 
in means was 4.34. The probability is less than 
1 in 1,000 that a critical ratio this large can 
arise by chance. There is a reliable difference 
in the means of deaf boys and deaf girls on the 
test; consequently, the two sexes cannot be con- 
sidered to be samples from a common popula- 
tion with respect to the capacities measured by 


the test. 
In the light of this 


The mean Bet: 


finding it is desirable to 
see on which subtests of the Beta deaf boys and 
girls differ significantly in performance. By 
using the weighted scores for each subtest that 
are provided in the Lindner-Gurvitz standard- 
ization, it is possible to compare directly any 
person within the age range from 16 to 19, 20 
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to 24, and so forth, without considering growth. 
Thus the boys and the girls, each group rang- 
ing in age from 16 to 19, can be directly com- 


pared without regard to variations in age with- 
in that range. 


The differences in means of the weighted 
scores for the boys and the girls on each of the 
six subtests of the Beta were tested for signifi- 
cance. Three mean differences were statisti- 
cally significant, and these were in favor of the 
boys. The three subtests in which significant 
differences appeared were “error recognition,” 
“paper form board,” and “picture completion.” 

The subject matter of the drawings in the 
items for “error recognition” is largely mas- 
culine. The “paper form board” subtest is sim- 
ilar to those appearing in mechanical aptitude 
tests. In “picture completion” t 
ponderance of masculine or fe; 
tion. 


here is no pre- 
minine orienta- 


Summary 


In order to test the assumption that the 
norms for the Revised Beta Examination can 
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be used with deaf women, the norms being d 
rived from hearing males only; the test E 
of 79 deaf girls and 109 deaf boys meya i 
and 19 years of age were analyzed. bj 
shown that the performance of these su zel 
was not indicative of a sex difference "e A 
gence quotient on the Chicago Non-Ver! “al 
amination and the Pintner Non-Lat A 
General Ability Test, which had a ‘ 
been given to the subjects. On the Ber in 
ever, a significant sex difference in a 
ligence quotient existed in favor of th 


| 

f 

a th 

Subtest analysis located the difference in 
| 


s 


subtests, two of which are masculine n 
tation. It is concluded that the Beta a 
not be used with deaf girls of 16 to 19 Y 
age without appropriate norms. 
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A Validation of a Bender 


„Gestalt Scoring System ` 


Murray Lonstein 


VA Hospital, Lebanon, Pennsylvania 


a The Bender- 
ee of test 
Clinics throug 


Gestalt test (B-G) has become 
aerie in many hospitals and 
Wantification sins the country. Its need for 
Nized, and, a and Validation has been recog- 
een OE aaa! scoring systems have 

Ne such ets several investigators [1, 4, 5]. 
nd Suttel] ur system, constructed by Pascal 
Study in yie ], appears worthy of further 
Claimed tate = the fact that its authors have 
Ubjects fro the method discriminates normal 
m neurotics and psychotics. Further- 


a 


Ore, x 

; obins 

differentiates th. [6] found that this system 
and sch; he B-G performances of paretics 


chiz : 
the UZophrenics 
claims of Pase, 


Oring and coll 


and Cornutt [2] supported 
ascal and Syttell in regard to 
he prese ection of their normative data. 
Uther the E study was designed to validate 
X Sstablish sent Suttell scoring system and 
nen It tra eg usefulness in a hospital 
re Sensitive x held that even if the system is 
™ normal nen to distinguish neurotic 

cars, SVBjects, as Gobetz [3] claimed, 


its ef 
ng psychotic from non- 


ica 
Psychotic >. in separati 
Use, Patients w 
would merit its continued 


A total of 9 Procedure 
Sina ree records of psychiatric pa- 
h Y accordin ns hospital was scored by the 
nd § D the directions given by Pas- 
a siy this technique involves 
Psychologist of Designs 1-8, 
E to criteria given in 
A = of points for each 
these he a with its severity- 
Afte into a sta 2 s the raw score, which 
Sine the record ndard measure or z score. 
rane’ OF the S were scored, the psychiatric 
any Te pl Patients were obtained and the 
a e into two groups, “psycho- 
th Chotic.” In the psychotic group 
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there were 41 schizophrenics, 4 psychotics with 
organic brain disease, and 2 manic-depressives. 
In the nonpsychotic group there were 40 anxi- 
ety reactions, 6 passive-aggressive reactions, 
1 obsessive-compulsive reaction, 1 dissociative 
reaction, and 1 alcoholic. 

Since the Pascal-Suttell z scores are based on 
exclude subjects whose education 
is below the ninth grade, 23 patients who did 
not meet this standard were not used in the z- 
score comparison. They were included, how- 
ever, in the raw score analysis. 


norms that 


Results 


As indicated in Table 1, the means of the 
standard score distributions of the two groups 
differed significantly; likewise, the means of 
the larger raw score distributions also differed 
significantly. These findings indicate that the 
Pascal-Suttell scoring system meets the statisti- 
cal criterion in differentiating psychotic from 
nonpsychotic patients, using either raw or 
standard scores. 


Table 1 
of B-G Standard and 


Statistical Comparisons 
and Nonpsychotic Groups 


Raw Scores of Psychotic 


Standard scores Raw scores 


Statistic Non- Non- 
Psychotic psychotic Psychotic psychotic 
N 36 37 47 49 
M 72.19 56.05 35.30 23.96 
SD 22.48 14.12 22.56 14.53 
CR 3.67 (p < -001) 2.92 (p < .01) 


e null hypothesis may be reject- 
degree of confidence, it was 
opriate to evaluate this tech- 
method by determining from 
of true and false posi- 
fy this important cri- 


Although th 
ed with a high 
deemed more app” 
nique as a practical 
the data the percentage 
tives. In order to satis 
tenon, it was necessary to find appropriate cut- 
off points to separate the two groups. Pascal 
and Suttell report that z scores between 50 and 
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72 are suspect for psychiatric illness. A z score 

of 60, one standard deviation above their nor- 
mal group mean of 50, is suggested by them asa 
reasonable cutoff score in differentiating be- 
tween patients and nonpatients. 

Inspection of the data reveals that of the 36 
Psychotic records on which z scores were com- 
puted, 24 patients had scores greater than the 
Suggested cutoff score of 60, and 12 had scores 
below 60. As indicated in Table 2, 66.66 per 
cent of the psychotics were correctly iden- 
tified. Of the 37 nonpsychotic patients, 13 had 
Scores above 60, whereas 24 had scores below 
60; that is, 64.86 Per cent were correctly iden- 
tified. In the total sample of 73 patients, the 
Percentage of true positives was 65.76 and the 
percentage of false positives was 34.24. 


Table 2 
Percentage of True and False Positives with Cut- 
off B-G Scores of 60 and 65 


Percentages Cutoff score Cutoff score 


at 60 at 65 
Yo psychotics 


correctly identified 66.66 


å 


63.89 
% nonpsychotics 
Correctly identified 64.86 73.38 
Total % 
false positives 34,24. 
Total % s 
true positives 65.76 71.23 


; Since all the subjects in this study were hos- 
Pitalized and therefore maladjusted to some 
degree, it seemed reasonable to select a some- 
what higher cutoff score; accordingly, a cutoff 


score of 65 emerged as a more effective score 
for reducing the total p 


itives, Only 8 of the 3 
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would be helpful diagnostically. According! 
the time measures (seconds teken to on 
of the designs) were compared on a group 
The psychotic group’s mean time mei 4 
445.03 seconds, with a sigma of 220.2% 
onds; the nonpsychotic group averaged 334 
seconds, with a sigma of 112.82 seconds. E 
critical ratio derived in this compar iaa 
2.29, significant beyond the 05 level E 
fidence—that is, psychotic patients Wi 
more slowly on the test than did nonpsy*” 
tic patients, 


Discussion sno 
Although the Pascal-Suttell scoring ace! 
meets a high statistical level of confide ot 
differentiating between hospitalized PI% 
and nonpsychotic patients, it is by no eti 
infallible in the practical, clinical set% 
Nevertheless, in practical work it can e 
minate between these two groups on 4 df 
than chance basis. The variables selecté 
Scoring are therefore of diagnostic impo” v 
and perhaps should be studied by thoa 
use this test even though they may not for) 
score each B-G record. However, bie 
scoring procedure can be learned easily fi 
record can be scored quickly, the teca 
should be of practical usefulness in 
settings. indi 
As Pascal and Suttell point out, a” w 
dual z score derived by use of their ake n ig) 
be interpreted with caucion. Althoug s | s| 
z score suggests psychiatric illness, 1t ic. y 
always mean that the subject is psy chorni sU 
factors incidental to the testing gee f 
as fatigue, may contribute to high S oes 
all such test measures, the score din? 
viewed along with other test scores a” cri e 
data. Furthermore, the fact that the nosis y 
used in this study is psychiatric ens of th 
Poses some limitations on the reliability 
results. 


Summary of hy 

A validating study was carried 0U pend i 

Pascal-Suttell «scoring system of t 

Gestalt test. The records of 96 Piha of 
Patients were scored, and it was foun of 
technique differentiated psychotic | : 
Psychotic records by meeting statistic@ 


i ge 5 teria 
and, in a limited way, practical crite” 
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cidental finding is that psychotic patients took 3. 


More time in reproducing the designs than did 
Nonpsychotic patients. 
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Gellerman’s Complex Crossover Design’ 


Julian C. Stanley* 


Department of Education, University of Wisconsin 


In discussing the analysis of his Form I and 
II Arthur scores, Gellerman [1, p. 129] states: 
“The F-tests were designed after the manner 
described by Grant . . .” [2]. Yet on page 127 
he indicates that assignment to the two coun- 
terbalanced order-of-testing groups (I-II, II- 
I) was not random: “Subjects were selected 
by the matched-pair method to insure minimal 
group differences. The factors controlled in se- 
lection were sex, chronological age, mental age, 
previous experience with the Arthur scales, 
and etiological classification.” 
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3 an earlier draft 
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b 
or not his conclusions would be alend 
complex breakdown. To illustrate K e de 
signs and their analyses in connie a 
the present writer divided 28 studen grou? 
ly into two groups of 14 each. One ared f 
ceived the two forms of a locally Rer 0 
examination in A-B order; the oth ni 
took Form B first. Form A proved S'£ 
ly harder than Form B. ’ sated 

Then Gellerman’s design was ae 
artificially assigning “sexes” and n “erti 
like-sexed students across orders. The e! 
mean square for form differences atl sc 
11.4 to 4.9. Thesé were not Gellerma® that 
but it appears reasonable to surmise 

en 
MA difference would also have ba ne! 
More significant, rather than less a he 
employed the longer analysis. No © . 
parisons were basic to nis study- d subj 

Gellerman need not have matche ping’ 

; aken mate | 
or else he might well have taken oss0ve® i 
plicitly into account. The basic Ta he 
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fore, despite greater possible eflic i fe 
nine-part analysis, the simpler one S¢ selves 
avle unless added comparisons them 
of interest. 
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Mental Age Equivalents for the Revised 
Stanford-Binet Vocabulary Test’ 
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Table 1 


Raw and Smoothed Mean Vocabulary Scores and 
Mean Composite Mental Ages of Age Groups 
6 to 18 Inclusive, 

Revised Stanford-Binet Tests of Intelligence 


Mean mental age 


Age Mean vocabulary score 

group Taw Smoothed Raw Smoothed Smoothed 
6 5.8° 6.09 6.09 6-1 
vf 7.0 7.0 7.19 7.19 7-2 
8 8.3 8.3 8.23 8.29 8-3 
9 10.0 9.8 9.43 9.39 9-5 
10 11.4 11.6 10.47 10.49 10-6 
11 13.7 13.5 11.49 11.54 11-6 
12 15.4 15.5 12.39 12.51 12-6 
13 17.4 17.1 13.50 13.33 13-4 
1+ 18.2 18.5 13.80 14.01 14-0 
15 20.0 19.8 14.73 14.66 14-8 
16 21.2 21.0 15.24 15.29 15-3 
17 22.0 21.9 15.76 15.77 15-9 
18 22.5 22.5 16.09 16.09 16-1 


$ Extrapolated. 


scores for age groups 7 to 18. Why he did not 
give the average for age 6 is not clear, as vo- 
cabulary is one of the 6-year tests of Form L. 
Since these mean scores vary irregularly from 
their general trend because of sampling errors, 
is was necessary to smooth them. This was 
done in two steps. First, a five-point weighted 


moving average, W 
abolic, and cubic tren 

points but removes irregulari 
ezder, was applied [1, P- 
ao = 5]. Since minor irre 
erate a spurious cubic tren 


five points, this formula ten 
smooth, and it leaves unsmoothed the two 


points at each end of the series. A seven-point 
formula would have given better smoothing 1 
the middle range, but it would have Jeft three 
points at each end (half the points 10 the er 
ies) unsmoothed. In the second stePs the firs 


374, Formula 29.7, 
gularities may gen- 
d over as many -as 
ds slightly to under 
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differences of the five-point-smoothed series, 
including the two unsmoothed points at each 
' end, were set down, and a few additional 
changes of one digit after the decimal point 
were made in such a manner as to regularize 
these differences. From the figures at the top 
of the smoothed series and of the difference 
table, one additional value was added to the 
series by extrapolation at age 6. Column 3 of 
Table 1 gives the smoothed series. 

Terman and Merrill give the Form L and 
Form M mean IQ's for all age groups of the 
standardization sample [3, p. 35, Table Si. 
The two mean IQ's for each group were aver- 
aged and then multiplied by the age, or by the 
equivalent chronological age divisor in the case 
of age groups 14 to 18 [3, p. 31, Table 4], 
to obtain the mean L-M composite mental age. 
These means are given in Column 4 of Table 
1. The same smoothing procedure was applied 
to them also. In the second stage, no change 
as great as one digit in the first decimal was 
made. The smoothed values, in years and hun- 
are given in Column 5 of Table 1. 
These values were then converted to years and 
months as shown in Column 6, 


The entries in Columns 3 and 6 of Table 
1 were then plotted on a large sheet of 1/10- 
inch, Cross-section paper, using 1/2 inch per 
unit of the vocabulary score and 1/10 inch per 
month of mental age. It was noted that the 


trend between the Points for ages 10 to 18 was 
almost exactly linear, 


McNemar re 


, 
ne point was there- 
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some further confidence in the accuracy off 
mental age equivalents of scores hig 
that of the 18-year age group average. n 
The line was continued downwara E 
smooth curve through the averages A F 
groups 6 to 9, and extended one ie i 
further downward and two score po! 
ther upward. , 4 
The mental age corresponding aan 
score from 5 to 40 was then read id i 
curve. Accuracy of reading was che f 
forming a difference table of the mg i 
equivalents, and a few changes of on fat 
were made in such a manner as to ri af 
these differences. The resulting men 
equivalents are given in Table 2. 


Table 2 athe! 
Mental Age Equivalents of Raw Scores 0 


Test 
Revised Stanford-Binet Vocabulary K 
MA 


5 5-4 23 
6 6-3 24 
7 2 25 
8 8-0 26 
9 8-10 27 
10 9-7 28 
1 10-2 29 
12 10-9 30 
13 11-3 . 31 
14 11-9 32 
15 12-3 33 y 
16 12-9 34 nd 
17 13-3 35 ae | 
18 13-9 : 36 2 | 
19 14-3 37 a 
20 14-9 38 ye 
21 15-3 39 
#22 15-10 40 


* Values in this column are interpolata vis 
Point: score 88 (highest made in bar a2 an 
group; N=2) taken as equivalent to rfectly tyo 2 
160). This interpolation corresponds pe oros 14 
trapolation upward of the curve from s 
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iF te cae reliability could be this low 
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singe = le imate of its reliability 
standar i 
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at ard error of n i 
an leton me a heasurment is the 
Yee foot ee on, scores times the 
ee. minus the reliability. Thus 
ement ig poe standard error of mea- 
i tion ot ee half the standard 
.1 H ie T res. McNemar’s Table 44 
€ standard deviation of the 
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adjacent mental ages 
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that in interpreting 
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such 1Q’s we can place some confidence in the 
first figure, or the first two figures if the 
1Q is 100 or over, but none in the last figure. 
The 95 per cent confidence limits for a given 
vocabulary IQ are approximately plus or 
minus 20 points. 


Summary 


Table 2 gives mental age equivalents of 
scores on the vocabulary test of the 1937 Re- 
vised Stanford-Binet Tests of Intelligence. 
Any inaccuracies in the table, whether due to 
the method of its derivation or to the limi- 
tations of the original standardization data, are 
small in comparison to the unreliability of the 
test. 

Despite its limited reliability, which is inevi- 
table in a 45-item test covering the whole 
range from age 6 to superior adult, this vocab- 
ulary test is useful as a short verbal scale. 


Vocabulary IQ's may be computed from 
these mental ages by dividing them by CA up 
to age 13, and thereafter by the CA equivalents 


used with the 1937 Revised Stanford-Binet 


Tests of Intelligence. For the interpretation of 


any such IQ, its last digit has no significance; 
the standard error of measurement is about 10 


points. 
uary 12, 1954. 
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Arnold, Magda B., & Gasson, John A. The human 
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therapists and some psychoanalysts that the open- 
ing interview involves no evaluation or diagnosis. 
Instead they attempt with considerable success to 
blend a diagnostic attitude — appraising the pa- 
tient’s need, motivation, and capacity for therapy — 
with a recognition that the first contact is an integ- 
ral and often crucial part of the therapeutic process 
itself, The book consists of 119 pages of exposition 
and theory with a good review of the literature on 
the initial interview, and of 278 pages of verbatim 
illustrative material. Three initial interviews are 
given in full, with the transcripts on the left-hand 
pages and a parallel discussion on the right-hand 
pages. Two of the interviews, by experienced and 
able therapists, illustrate the application of the au- 
thors’ approach. These interviews are not perfect, 
as the authors readily admit, but they are vivid and 
instructive. The remaining interview, conducted by 
an inexperienced student, shows most of the mis- 
takes that can be made in interviewing — the in- 
terviewer’s self-involvement, his inability to really 
hear the patient, and his defensive dependence on 
routine questions. The technically excellent phono-, 
graph records, available at cost to qualified pro; 
fessional persons and institutions, give the listene: 
many cues that are lacking in the printed transcripts: 
The authors’ moderate and eclectic conception of the 
initial interview will appeal to most readers as 
sound and widely applicable. The book and records 
supply unique and useful tools of instruction for 
clinical psychology and social work as well as for 


psychiatry. — L. F. S. 
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nically trained worker of the present. Books of this 
kind can do much to bring the two together. There 
is still, however, a great gap between the better 
books in guidance like this and the new volumes on 
counseling and personnel techniques. — F, McK. 


Peck, Harris, B., & Bellsmith, Virginia. Treatment 
of the delinquent adolescent. New York: Family 
Service Association, 1954, Pp. 147 (paper). $2.00. 
The authors have given us a realistic picture of 

the difficulties and successes in the use of psycho- 

therapeutic techniques with delinquent adolescents. 

There is an excellent appraisal of the limitations 

and potentialities of group therapy, both with par- 

ents and with adolescents themselves. Educators, 
family and social agencies, and all those working 
with delinquents will find this book challenging 

reading. — B.M.L. 
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xiety that could be correlated with our TAT 


Procedure 
Subjects 
The subjects of this study were 20 under- 
graduate males who had volunteered from an 
introductory course in psychology at Harvard 
College to participate in a program of person- 
ality study. They were paid for their time o! 
an hourly basis at customary student rate 
The subjects were selected so as to be hetero » 
geneous in regard to such factors as soe 
onomic and ethnic background, academic per- ` 
formance, and extracurricular activities. A 
Thematic Apperception Test 
Administration. The TAT was administered 
under standard conditions with the two ses- 
sions separated by 24 hours or more. In all 
cases the stories were electrically recorded with- 
out the subjects’ knowledge and later trans- 
cribed verbatim. 
Scoring. Our scoring procedures were based 
atements culled from the literature. In 
e will first present the per- 
d following this we will 
summarize the variable or variables that were 
designed to correspond to those mentioned in 
the statement. The reader will notice that we 
have not attempted to exhaust the meaning of 
these quotations but have simply selected, some- 
what arbitrarily, certain variables that seemed 
especially pertinent or easy to objectify. In all 
there were 18 signs or variables, presumably 
sensitive to anxiety, that we attempted to 
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measure. 
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able, all scores were dichotomous as the scorer 
simply indicated for each story that the vari- 
able was present or not present (high or low). 
In some cases, this required setting relatively 
arbitrary cutting points. Thus, for all but the 
second variable, the subject's score was made 
up of the sum of 20 yes and no scores and con- 
sequently could range from 0 to 20. 


[Anxiety is indicated by the] . . . presence of 
disruptions in the consistency of form charac- 
teristics, especially in organizational elements, 
in vacillation from concept to picture-domin- 
ated responses, and in rejections and refusals; 
content characteristics . . . of overt aggression, 
depression, mental conflicts or other outstanding 
emotional states .. . [Henry, 2, p. 48]. 

1. Intrapicture wvacillation from concept- to pic- 
ture-dominated responses. A concept-dominated re- 
sponse is one whose main theme deals with an idea 

-the picture suggests rather than the picture itself, 
Me may be abstract, symbolic, or allegorical, and 
y to the general 
se is one whose 
he events of the 
€ action is omitted, 
akes place in the 


ase. A picture-dominated respon 
Ymain theme deals directly with t 


and in general the story action t 
here and now of the picture. At its most restricted 
level the response may be only a description of the 
picture with little or no plot. If during a single 
Story there was one or more shifts from one type of 


Tesponse to the other, the Story was scored “yacilla- 
tion,” 
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ugi 
natives of conation are most frequen 
special expressions connoting Mae at 
tation, and trepidation are freely is 
direct identification of the narrator ae y 
acters in his phantasy frequently ote 
phantasied situations are left as U of the 
the underlying emotional con A 
ject [pp. 80-81] [Balken and 7 e intra 
5. Intense conflicts. The conflict ane emo 
interpersonal. It should involve dividual 
states and if it is intrapersonal the in ie conflit 
be seen as “torn” by the two sides of “abject 
6. Vagueness and hesitation. The hed oot 
iavo or more statements showing ee nif w 
or hesitation or both, e.g„ “I’m not sures ie 
know,” “I can’t tell.” openly aor 
7. Self-identification. The narrator acts Hike 
that one of the characters resembles pt the stot 
self. He indicates that part or all © 
taken from his own life. 


> has 2°, 
8. Unresolved conflicts. “The ay ni 
come. Conflicts, situations, plots are ‘€ comes © 
Statements like “I don’t know how this a ci 

“I don’t know what comes after this ining ® 
Or, conflict situations are seen as pma «And 
“And he never forgives her for that, 


couple continues to quarrel.” uo OF ty 
9. Interjections. The subject makes T story b 
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the future. He has an expectation that unpleasant- 
ness lies ahead. “Things don’t look too bright for 
the future.” “I’m afraid the situation gets worse for 
these people.” 
Anxiety neurotics had many plots emphasizing 
sudden physical accidents and mental traumas 
such as loss of wife, mother, sweetheart or jobs, 
house burning down, stock market crash, etc. 
thus reflecting their own fears and the insta- 
bility of their world [Rotter, 5, p. 30]. 
18. Trauma, The content of the story deals with 


a theme in which: (a) one of the characters has a 
sudden physical accident, e.g. “and then he fell and_ 
broke his leg,” “.. . when suddenly a rock dropped 
on her”; (b) someone undergoes a severe mental 
trauma, characterized by its lasting effects. 
Reliability. In estimating the reliability of 
the TAT scoring we selected at random 100 
stories, and a reliability rater scored these for 
each of the variables. These ratings agreed 
with the experimental ratings in 829% of the 
cases, indicating a relatively high degree of a 
sociation between the two sets of ratings. 


Criterion Measure 

The primary independent measure was å 
“diagnostic council” rating based upon a very 
wide variety of information derived from ob- 
servation, self-report, situational tests, and a 
large number of indirect measures. After pre- 
liminary analyses, this information was pre- 
sented individually for each subject and dis- 
cussed in a council of clinical psychologists. 
During this session the group assigned a tenta- 
tive rating to each subject to indicate the im- 
portance of anxiety as a determinant of his 
behavior. Later all the subjects were considered 
jointly and ranked in terms of the degree or 
importance of anxiety. In addition to the diag- 
nostic council ratings, scores were available 
for the Psychosomatic Inventory which pre- 
sumably should bear some relation to anxiety- 
We obtained a rank-order correlation of .69 
between the total score of the inventory and 
the clinical ranking. 
Statistical Analysis 

In most of our analyses we relied upon rank- 
order correlation as 4 statistic suited to the 
relative crudeness of our data. In attempting 
to relate our “signs” to the subscores of the 
Psychosomatic Inventory, we used a technique 
described by Mosteller [4] for estimating cor- 
relation coefficients. This short-cut method was 
used as these relations were of relatively slight 
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Table 1 
Relation of TAT “Signs” of Anxiety to Criterion Measures ———— 


Psychosomatic inventory 


Feat 
I Clinical Total Psycho- Gastro- Nervous Worry 
TAT variable ratings score somatic intestinal tension m: =i 
1. Intrapicture 05t —.32t —38 4 —49 ł Bik pone Kj 
vacillation ğ J 35 = 
2. Interpicture —.38 —.04 —14 —19.5 — 85 ; 
vacillation š +27.5 TA 
3. Rejection and 30 40° +33.5 +13.5 +26.5 F, 
refusal 37.5 a 
4, Outstanding —.06 —.02 +10 =— 15 —7 . 
emotional 5 
states -ii 
5. Intense .03 -06 + 8.5 + 3.5 + 9.5 —30 ; 
conflicts ‘ 18" 
6. Vagueness 40" 15 aie — 75 Fie ny" i 
7. Direct identi- 39° 09 — 15 —5 +7 = k ; 
fication Bs: 
8. Conflict un- 22 —.02 — 55 —28 —1 —29 
p~ N resolved +i 
\9. Interjections .06 21 +17.5 9 +25.5 FPO A 
5 0. Verb/adjective —.09 —.13 — 9 —31.5 —23 TZ i 
y quotient = 
a. pa 13 09 + 7.5 +33 +11.5 —§ ; 
12. Briefness As 31 +36 451 +10 +26 ts 
13. Object 38" .53* 443 7 432:5 
description P? vas os 
14, Feeling and 22 02 +19.5 +4 = 18 =“ 7 
expectation i 
description s 
15 e a =46 99 u —22.5 —21.5 —29.5 
x : 
wish + 1 
16. Blocking 33 -20 +20.5 +11 ASF +25 Ail 
17. Aapeehenddre: 05 —.04 — 8 — 1 —2 is 4 
S Por 
18. Trauma —.19 10 +75 4-22 +23 : p 
A a a tH 
t Rank-order correlation. - ; 
Mosteller's correlation approximation, T í 
7 E E sede ` y 
E big and indicating the direction of the re- of approximately the same magnit r as d 
a a existence of strong relationships findings are not encouraging Segs” s 
be Hi E ee A perfect correlation would utility of the particular TA houg ti 
~ gniled by a score of 96 using this tech- ployed here are concerned. Alth d assoc i 
nique. Sal d f a tendency towa" crite 
Bedemi — me evidence of a 


. ou i 

O j between the TAT variables an onder?” 

i = Major results are summarized in Table measure, as witnessed by the ee tent 

TH cre we find that, of the 18 TAT signs, 13 positive correlations, this seems a vo ri ne i 
ow some trend sociation link, and the existence of relative jy he o 

tive correlations suggests dramati’’ © o 


; atio 

: idan (vagueness and hesita- we are from an adequate form aa mene if 
tion, se -identification, object description) are to measure anxiety with this inst” T a 
significant at the 5% level, and there is one 


: e 
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and the Psychosomatic torent ey 
marized in Table 1. In generat, 
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Table 2 


Rho Intercorrelation of TAT “Signs” of Anxiety 


th 
© of 144 m T, 


ndencies 


Boe in the clinical rating 
hésomatic ch for the total score and 
elati ns is € subscore the direction of the 
iscussed, pwd to those we have 
Se ny less, a although the magnitude is 
these ity of thi View of the presumed lesser 
i S Paper-and-pencil instrument, 

Table > S t0 be expected. 
We present the intercorrelations 
2 signs. If we exclude the 
ae piles na appeer to have been 
itive ie, the general tendency 
fd orrelations. In general this 
Som $ for 2 ations does not suggest a set 
£ ese pe or very similar variables. 
Igns are in fact highly indic- 


refusals 
Emotional 
states 


Object description 
Memory followed 
by wish 

Apprehensiveness 


Feeling and 


Number of adjec- 
expectation 


tives 
Blocking 


Self-identification 
Briefness 


Vagueness and 
hesitation 
Unresolved 
Verb/adjective 
quotient 


conflicts 
Interjections 


Intense 
conflicts 


=.27* 
-.28 —.10 
+25 —.03 —.18 
25 —.25 —.13 .85 
14-52 .53 -.41 -.25 ay 
Kees 
25-20 .52-19 .00 .33 s 
60 -.20 -.03 .41 .53 -.04 .38 
-04 -20 .75 .03 .21 .56 .19 -.01 
“18 121 40 .36 .25 -.30 -.36 —.05 -27 
25-11 37 -.36 —.33 21 42-04 -16 -89 
=71 26 35-37 -.50 .02 -.12 —33 -.02 -.02 „10 
510 26 154-32 -37 .18 47 .02 11-30 32.30 
=26 06 2i-di is 08 42 15 «03-24 .12 AL 14 
=i =.06 .03 89% .342103 AT cl 7 08 —.28 -.09 -.09 25 
10 -.10 
07 -A8 75 — ag 32 16 59-27 18 18 20. 
I oe eee 2 3g d3 SL 30-37 —-43 —.12 .36 -.07 
: “i7 i2 05 -11 -12 -39_ 17 -17 .69 


red for significance at the 6% level. 


y, then it seems evident that 
others are not very sensitive to this variable. 
Nevertheless, several interesting clusters a 
pear. In one we find the following variables: 
strong emotional states, intense conflicts, oe 
prehensiveness, and trauma, while in the other 
-we find: rejections, hesitations and uE 
interjections, and blocking. The question Ot 


how much these represent related psycholog! 1 
h the association 1s arti- 


variables and how much ! di 
ficially produced by scoring the same story at 


tributes under multiple headings 1s ge ae! 
arswered by our 


data. Certainly an ex) te 
tion of the definitions of these eight Wea 
suggests that some of these inter oer P 
are the results of mu 


ative of anxiet 


Itiple scoring of t 
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aspects of the stories. 


Speculation concerning the relatively strong 
negative correlation between our measure of 
interpicture vacillation and our criterion mea- 
sure of anxiety suggested that a variable 
of rigidity or inflexibilty might be mediat- 
ing this relationship. A low picture-vacilla- 
tion score implies that the subject adopts an 
initial set toward the story construction proc- 
ess and maintains this without variation 
throughout the series of Pictures. The widely 
observed “freezing” effect of anxiety makes it 
understandable that the individual high in anxi- 


lation and intrapicture vacillation variables, 
as these measures seemed obviously to be get- 
of their low 
variables we 
ginal scoring 
e correlation 


38 correlation th 
given us. Next we included scores for the 


The fact that through the use of three vari- 
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ables we were able to secure a correlation of 5 
with our criterion and that with the add 
of two more variables we could raise this 
-63 suggests that potentially the TAT may 
a relatively sensitive indicator of anxiety. i 
the other hand, in evaluating these fiat 
is important to consider the small size 0 
sample and its composition. Our subjects 
met some criteria of normality althoug ad 
least four of them presented rather serious ê- 
justment problems. Even these four, a 
compared to severely disturbed patients, Pay 
ably could be characterized as only moder 
anxious. Thus our results are based upon 
stricted range of the variable of intere a 

The relative success of our formal mea the 
in predicting anxiety when compared 9 the 
content measures suggests that analysts ©" è 
TAT might well devote more of their a 
to this type of variable. It is, of cours A 
sible that this finding may be rather sp r 
ically linked to the nature of the variable 
der study. 


i 
In summary, our results are somewhat dp 
couraging for the utility of common ETAT 
zations concerning anxiety and the ble ” 
Nevertheless the tact that we were @ ye 
find relatively substantial correlations bet o 
our criterion measure of anxiety an ef). 
clusters of TAT variables that bore me ul 
tional relation to each other suggests : ns 
tential utility of the instrument in wae et 
If we take seriously the highly tentatlV’- of; 
dence of this study, it seems that the a g 
the anxious person is characterized by ach? 
cessive sameness or rigidity in the app” r io” 
the storyteller, a preference for age ine 
self to simple object description, 2 ee a 
to relate parts or characters in the eat 4 
Plicity to himself, a tendency to be Y als? 
hesitant in presenting his stories, 22° “gus 
readiness to reject his productions 4° 
to tell or complete his stories. 
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Brief Intellectual Assessment of Patients with 
Behavior Disorders”? 
Herbert W. Eber, Carl M. Cochrane 


University of North Carolina 


and Albert A. Branca 


VA Hospital, Fayetteville, North Carolina 


In treatment-oriented situations differentia- 
tion between essentially normal and very low 
intelligence is often sufficient. The Wechsler- 
Bellevue requires lengthy administration time 
disproportionate to the information required in 
these cases. The SRA Non-Verbal Form P, 
a ten-minute test (plus one minute for scoring) 
with well-standardized norms and a reliability 
f .85, does not sample intelligent behavior 
roadly enough to confirm very low intelli- 
ence; in this study, it was evaluated for its 
low intelligence. 


For purposes of com 


a Parison the scores on 


r tted into Percentiles, 
cording to the method 


A s Rar A 
From the Veterans Administration Hospital, Fay- 


etteville, North Carolina, 


of Congress, 


vance $1.25 for microfilm or $1.25 
iake checks 


«pe O} 
Wechsler used in his statistical define 
intellectual levels. His cutting point ae at 
“borderline” and “dull normal” was tuts 
minus 2 PE, the 8.9th percentile. In this ast 
the class essentially normal was cei 
or above the 9th percentile; very low V 
fined as below this point. Pp f 
The results are shown in the 
contingency table: 


ollow” 


1 
a 
RA Nort 
SRA Low S B 


Wechsler normal 7 
Wechsler low 12 


ient scoti"? 
Thus it was shown that any patien he pi 
at the 9th percentile or higher on t 5 w 
scores above this mark on the Wechsler- qH 
converse relationship does not ho DA anl 
correlation (product-moment of a ut 
scores derived from percentiles) is a ee, pa 
Predictive value for our purpose is oresentl ll 
the correlation shows, since an nee f 
normal score on the SRA apparently he 3 
like score on the Wechsler., Thus 2 at a 
may be regarded as one-sided instrum" irn? 
able of ruling out very law intelligence 3 
capable of confirming it. 2 cast 
Conclusion. On the basis of the 3 FO 
-Verb iw) 
was concluded that the SRA Non ients Yg 
was a useful screening device for pana is ie 
behavior disorders. when the only nce t° y 
select those high enough in intelliges witho 
considered essentially normal. Patien e the a 
brain damage who score at or Abov Jered ff 
percentile on the SRA may be ec pel", 
normal, intelligence, while those =“ obtal? 
this point need further evaluation jeve! 
broader based estimate of intellectu 
Brief Report 
Received June 25, 1954. | 
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Detection of Suicidal Patients: An Example of 
Some Limitations in the Prediction of 
Infrequent Events 


Albert Rosen 


4 

| Since ¢ 

ân import 
Ogists, an 
Or eval 
items f 
tificati 


i Perion of suicidal patients is 
‘iste at nan of clinical psychol- 
uated he: Investigators have proposed 
rom ps iai signs, configurations, and 
on [1 ychological tests for their iden- 

H $19: 317 290, 326; 7; 8; 9; 12; 14; 

are (a to ; 21]. The purposes of this paper 
fication of Suggest modifications in the classi- 
¢mphasize Patients in suicide research, (b) to 
the prediction « of the limitations inherent in 
ig general 7 = Suicide, and (c) to indicate 
the predictio mys icability of such limitations in 
Teque of any other behavior or event 
nt occurrence, 


Classifig 


ation : : ; 
of Patients in Suicide Research 


E term ent: 
Dats m “5 : a 
atien uicidal” has been used to describe 


b emor . 
: nst z 
vior, such rating heterogeneous kinds of 


© threats, as (a) suicide thoughts, (4) 


ide rad Suicide attempts, and (4) 
con Predictors, a c n previous research on sul- 
With ining of À amin practice has been the 
Suicig AtA from th ata from such individuals 

ide, those who actually committed 


Dig 
rentat; 
y on of “Suicidal” Subgroups 


„+ he 
Stigg. "eed for mo 


r re precise classification in 


esea 
a ka indicated by Farbe- 
© dem osen, Hales, and Simon 
| Deya CUPS can Pai ati that “suicidal” 
L Breeg Bical ge differentiated by means of 
Who | i in E. The two studies ĉlosely 
EXpDresg sang that, as a group, patients 
suicide thoughts or suicide 
iine the 
atry Polis, Mutopsychiatry Service, VA Hospital, 
a inical pe ane the Divisions of Psy- 
a. sychology of the University 
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~Jocated whic! 


VA Hospital, Minneapolis, Minnesota 
and the University of Minnesota? 


threats are much more severely disturbed than 
either patients who have made a suicide at- 
tempt or patients-in-general, and that patients 
in the latter two categories are similar to each 


other. 


Suicide Rates 

Additional evidencë of the need for greaters, 
refinement in the classification of patients in® 
suicide research is provided by statistics on the 
incidence of suicide. Suicide is an extremely 
infrequent event, and very few of those patients 
who are severely depressed or who express sui- 
cide thoughts or threats actually commit sui- 
cide. Thus, data from such patients should not 
arbitrarily be grouped under the class term 
“suicidal.” Examination of the following 
data on suicide rates provides substantiation of 


these statements. 
Suicide rate for the general population. In the 
United States, the suicide rate for the general popu- 
lation is 11.4 in 100,000 [20, p- 75]. Reliable statistics 
for the frequency of suicide attempts in the general 
population are unavailable because of the difficulty 
of determining objectively what is an “attempt.” 
Data on the incidence of suicide among psychiatric 
patients are sparse; they may be classified in two 
ways, according to occurrence: (a) after termina- 
tion of treatment and (b) during hospitalization. 
Posttreatment suicide rates among former psychi- 
atric patients. Only four published studies could be 
h reported data on the incidence of sui- 
cide among patients after termination of treatment. 
The authors of these reports obtained their data 
primarily by correspondence. The first three deal 
with psychoneurotics followed up for periods of 
from 2 to 20 years. Coon and Raymond [2] found 
6 suicides among 1060 cases, a rate of .0057. Ross 
[17] reported 4 suicides among approximately 1186 
reurotics, a rate of .0034. Denker [3] discovered 3 
suicides among 707 cases, a rate of .0042. Denke- 
cases had not been psychiatric patients, but had been 


diagnosed as neurotic. A fourth study, by Holt and 
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Holt [10], reported 2 suicides among a mixed diag- 
nostic group of 141 patients (a rate of +0142) with- 
in a period of 30 years after hospitalization. A 
third patient in this group committed suicide while 


under treatment subsequent to his initial hospitali- 
zation. 


Suicide rates for hospitalized psychiatric patients. 
The rate of suicide among patients undergoing psy- 
chiatric treatment is apparently lower, probably be- 
cause these patients are under close observation. Ross 
[17, p. 98] reported 3 suicides among 1186 neurotic 
patients, a rate of .0025. Two of these patients com- 
mitted suicide during the period of treatment, and 
the other, immediately after termination, Levy and 
Southcombe [13] found 21 suicides among 6509 ad- 
missions (a rate of 0032) in a large state hospital 
for the period from 1936 to 1949,2 

For the sake of the Present discussion, a rough es- 
timate of .0033 will be used to represent the suicide 
tate among psychiatric patients undergoing treat- 
ment. Although the rate may be slightly higher in 
some hospitals and clinics, it is evident that suicide 
occurs very infrequently among psychiatric patients. 


i Suggested Classification of Suicidal Patients 


p 


The need for more precise classification ir 
research on suicide detection is thus empha- 
sized both by the data on the low incidence of 
suicide and by the evidence earlier cited that 
“Suicidal” subgroups can be differentiated by 
means of psychological tests. In the develop- 
ment and validation of a suicide detection de- 
vice, one criterion group should consist exclu- 
sively of patients who committed suicide. 


Moreover, since a patient ma’ 
Personality ch 


administratior 


Tesponses of suicidal patients is available. The 
low incidence of Suicide, of Course, makes it 


velopment of a detection instrument, 


Limitations of Suicide Predictors 


A’ suicide detection 


‘ e instrument to be effec- 
tive, must identify a f > ; 


airly large Proportion of 
?Dublin and Bunzel [4, p. 3 
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suicidal patients (true positives) and eo 
not misclassify a large number of none 
patients (false positives). The low incl the 
of suicide is in itself a major limitation ia 
development of an effective suicide pre A 
for in any attempt at prediction of nia A 
behavior, a large number of false positiv thee 
obtained. To illustrate this point, a Re 

ical suicide detection index will be devis¢® 


Development of a Hypothetical Suicide 
Detection Index Sone 
Assume that a suicide detection inne ps i 

developed from test data obtained fron 0 

chiatric patient population divided Ty dur 

groups: patients who committed suicl nd PE 
ing treatment (Suicide population), ing 
tients who did not commit suicide 
treatment (Nonsuicide population). 

that the steps in the development and 

tion of the index were as follows: (4) 

dom sample of patients was selected frora 

of these populations ; (b) an index we cae 

which consisted of test data which’ signif E 

differentiated the two criterion samples 

all of the cases in the two samples were “til 

on the index; (d) a cutting line was o% 

lished so that an equal percentage, S4Y i, ctl! 

of the patients in each sample were e at 
classified; (e) for the purpose of cross v and 
ing this cutting line with new Sa Le 

Nonsuicide samples, every psychiat n th 

tient over a period of years was score ge pi 

index, and these scores „were not ae ae 

that they could have no influence on th im 

ment of the patients. ase 


e bi 
Cross-validation of the index. One her 
of the estimated suicide rate of .00¥ “no 
would be approximately 40 suicides jidat 
12,000 patients. Assume that, in erosi 
ing the predetermined cutting line, s 7 
slight amount of shrinkage occur poPy 
75% of the patients in each of the f able 
lations can be correctly identified. fot 


Mechi, 
ro 


eae 


_ Thr writer is indebtéd to Dr. Pioli 
indicating the importance of an inv rection ly 
approach to the »roblem of suicide de 


it 
*The figure of 75% is used becana ge 
represents the maximum eiectivens á ad be 
achieved with cross-validated prediction ‘Gonr poh 
cation devices. For exemple, Ellis ae ofits 
P- 406], in evaluating the effectivenet” lad) 
sonality inventories used for screening 


ea eae 


X 
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Table 1 
ry Number of Patients in the Suicide and Nonsuicide Populations 
Identified by a Hypothetical Suicide Detection Index 
with Three Different Cutting Lines 
Actual behavior 
Behayi 5 Total with 
mee predicted Did commit Did not com- predicted 
y index suicide mit suicide behavior 
Number fo Number Jo 

| Will Sac A. 75% True Positives; 75% True Negatives 
ill not sie | r 30 (75%) 2990 (25%) 3020 
| Total with mit suicide 10 (25%) 3970  ( 75%) 8980 
a actual behavior 40 (100%) 11960 (100%) 12000 

Wilommt as B. 60% True Positives; 90% True Negatives 
DOE ee 24 ( 60%) 1196 ( 10%) 1220 
tal vith accel wees 16 ( 40%) 10764  ( 90%) 10780 
ctual behavior 40 (100%) 11960 (100%) 12000 

Will Scan C. 2.5% True Positives; 99.5% True Negatives 
A eae 1 ( 25%) 60 ( 5%) él 
ah ane re 39 ( 97.5%) 11900 ( 99.5%) 11939 
actual behavior 40 (100.0%) 11960 (100.0%) 12000 


PRA 


i i . . 
cach Berle ae the number of patients in 
n the ae who are identified by the in- is essential to consider 

uicide population, only those pa- which is to be made wit 


who: . . . oe 
Se scores are above the stipulated the prediction of suicide, 
be evaluated solely in terms 


correct Classifications amon, 


tients 
Cuttin 


g lin `. k b 
tives) € are correctly identified (true posi- 


validation of any psychological 
the kin 


Only 3 Sem in the Nonsuicide population, } 
*curately el ose scores are below this line are dicted to be suicides. In Table 1, Part A, 
“Ctivenes classified (true negatives). The ef- there were only 1% of such correct classifica- 
ier of S of the index must be evaluated in tions. Among all the patients 1n the Suicide 
in both he number of correct identifications, and Nonsuicide populations, however, 9000 
» dicted to a ulations, among all the patients pre- Out of 12,000, or 75% were correctly classified. 
tlto © suicides, It is not appropriate or meaningful to evaluate 
90 of = be seen that with the use of the index the index in terms of the latter percentage, for 
Predige € 40 suicides could have been correctly there is no need to identify the patients in the 
the ed, Owever, of th : .”  Nonsuicide population. In fact, without any 
908 FOE LL ee ie test or other information, all patients could be 


Er 
2 


e © Would h 
tient » 2990 


Yalu “tection 


index would have no appreciable 


T 
(a Ite o i 
np lonia nedienian made with the index. 
the initial development or Cross- 


f 
por « 


Werg 


j 
~ 


hay Onsuicide 3 

Since een ie pee a pea predicted to be nonsuicidal, and the prediction 
‘very patient scoring. shoe tte cutting would be correct in 99.67% of all cases. 
Yicide ave been predicted to comm it Cross-validation of an elevated cutting line. 
tents 990 out of 3020, or 99% of such pa- For a suicide detection index to have any con- 
tide ae misclassified Ob . A h aisar ceivable value, the number of false positives 
i . Obviously, such a sui- -ust be drastically reduced. This could have 
Suicidal a lt would be im ical to treat as been effected in the original development of the 
Caseg, the Prodigious poe ee wie ssified index (step d) if a much higher cutting-line 
à ne % had been established. Assume, for example, 
that when this elevated cutting line was cross- 
validated (step e), only 10% o 
cases scored above the line ( 
ung ermal oa Ba ee positives). Assume also ie 
; aed urin; or 3 y 

dentigeg 50era, roughly 7% of each group T es re KAS la 


{ the nonsuicide 
ie, were false 
he new cutting 
liberal estimate) 
classified suicide pa- 


instrument, it y ; 
d of decision 
h the test results. In 
the test results must 
of the number of 
patients pre- 
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tients. Table 1, Part B, illustrates the results 
of applying the index to the Suicide and Non- 
suicide populations. Of the 40 patients „who 
did commit suicide, 24 could have been iden- 
tified by the index. There would still be 1196 
false positives, however, so that if every pa- 
tient who scored above the cutting line were 
called suicidal, the number of correct classi- 
fications would be only 24 out of 1220 or 2%. 
The index, therefore, would still be an im- 


practical instrument because of the large num- 
ber of false positives, 


Further reduction of the number of false 
positives. With every elevation of the cutting 
line for the purpose of reducing the number 
of false Positives, there will be a decrease in 
the number of correct predictions for the Sui- 
cide population (true Positives). If the origi- 
nal cutting line were raised so that in the cross- 
validation procedure almost all false Positives 
were eliminated, it might still be possible to 
detect one or two cases in the Suicide popula- 
tion by means of the index. Table Is Part C, 
illustrates such a hypothetical situation. Al- 
though only 1 in 61, or less than 2% of the 
predicted suicides, is correctly identified, the 
important consideration is that the number of 
false positives has been reduced to a relatively 
manageable figure. The writer can think of 
no other event of relevance to cl 
chologists for which one 
a low | 
attitude 


nsidered of some use, 
Prediction within 
to Certain Dig 


a Population Restricted 
gnostic Groups 
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a shin this 
course, is that the rate of suicide ie a 
restricted population would be higher t ae 
in the entire psychiatric patient ee af 
Two immediate obstacles to the use 0 Soleha 
proach are: (a) There is virtually ag 
information on suicide rates for given i ere 
categories. The writer panera) at 
port [4, p. 311] which provided a a of su 
of this kind. (b) As a smaller ai are 
cides occur within a restricted popu Sofi many 
in an entire psychiatric patient population, ‘ont 
years would have to elapse before $ 
number of cases with presuicide data CRR 
collected. It would be necessary, p in 
conduct a coordinated research pro 


installations. 
many installatior sail pt 


Additional limitations of the rest ‘ly be P% 
ulation approach. It would ogee rate 
sible to obtain information on su! also © 
within diagnostic groups, and it f cases wit 
ceivable that a sufficient number “i ven ! 
presuicide data could be collecte ite ; BON 
these two difficulties were sunmo app 
ever, the procedure of developing ^ ricted | 
ing an index within a population pe evel 
one or several diagnostic groups, j le W 

limitations: (a) The rate of suic fou” 


d be t ot 
still be low; probably no group coul the 


ould’ 


an 
with a suicide rate higher than i a jal 
would still be an excessive num rtion ° “ne 
Positives. (b) A considerable eit ed if 
cidal patients would not be aah the 1 vt 
restricted population, because of ba occ! me 
reliability of diagnosis, and (ii) t jnc! 3) 


of suicide in diagnostic categories n° 11; na 
in the restricted population [4 Pie and" Wy 
(c) Variables differentiating Sicut D a 
suicide patients would be more ous sub tiot 
tain within a somewhat homogene ula 


‘atric 
than within the whole psychiatr! ay 
nical Judge” act 

Prediction Based on Clinica ch 0 


i hic! FA 
x . s W aa 
The same kinds of difficultie jcide aio? 
: 5 ` tior of sul eelt of 
in psychometric prediction on “silt 
countered in prediction base jarge™ Ji” 
aang. ra tice a #4 pe Cy 1 
judgment.” In clinical prac ined: Thali 
of false positives are also o ‘ig ich” get 
cian, in referring to a eae 
willing to err on the safe side at 
many patients as though they 


to commit suicide. 


| Limitations in Prediction of Infrequent Events 


SA Basic Research 
a o = sshown that the effectiveness of 
(2) ike tes se instrument is a function of 
Population ( of suicide within a given patient 
Oe ent Peya or restricted), and (4) 
the suicide ge of correct classifications both in 
the ziven aus in the nonsuicide subgroups of 
Teven a ation. Other things being equal, 
| Population a will be most effective in the 
Within a with the highest suicide rate, Also, 
| that ee a with a given suicide rate, 
» classifies ts E e most effective which correctly 
of the ighest percentage of cases in each 
à Population subgroups. 
fan ao a to the development 
on of a Ja etection device is the acquisl- 
the distin rge body of information concerning 
vho A S characteristics of „patients 
lon, miken eee To obtain such informa- 
cans of co must be studied intensively by 
avior ratin mprehensive social histories, be- 
n T eiea psychological tests. The 
ed in eith g data thus collected may be utt- 
la) to excl s or both of the following ways: 
Suicides ‘a la e from consideration as potential 
arge proportion of psychiatric pa- 


lents . 
: In or A å 
With a der to obtain a restricted population 


hi i: 
“Umber Ehet suicide rate; (%) to find a large 
Which will iscriminating predictor variables 
correctly classify a high percentage 


ach o 4 
| Soups, f the suicide and nonsuicide sub- 


Bites «2? 
Mitations in the Prediction of Other 
Clinical Infrequent Events 
othe PE a al deal with virtually no 
p Ption might infrequent as suicide. One ex- 
ti the abe be the prediction of homicide, 
7s Pulation idence of homicide in the general 
5] Js about half that of suicide (20, p- 


thi, De limitati beat $ 
this Paper mitations of prediction discussed in 


ANY of 
l er behayi i 
. havior as its rate approaches - 


Po . 
Bienen dichotomized according to the 
am e Bee sence of the behavior.” » 
E ectiye ily of suicide detection provides 
en dering the stration of the’ importance of 
Population of n. of occurrence within a giv- 
n of any eyent which is to be pre- 


Ry 

al laboraty : 
x. Noblems wilt i this point and other methodologic- 
cehl ard He included in a paper by Dr. Paul 
the writer which is to be published. 


» however, apply in lesser degree to 
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dicted. Ellis and Conrad [5] emphasized this 
point in their critical review of personality in- 
ventories used for screening purposes in 
military services. They indicated that a large 
number at ple positives were unavoidable be- 
cause of the relatively . 
“maladjusted” rs eG o; 
. . some 
studies which were misleading because the 
false positives were reported only in terms of 
percentages rather than the actual number of 
cases. Moreover, they reported some investi- 
gations in which the normal and abnormal 
samples were equal in number, and which 
were evaluated as though the proportions in 
the population were also equal, i.e., .50 rather 
than roughly .95 and .05. Ellis and Conrad 
indicated that such studies provide a spurious 
underestimate of the number of false positives 
in the population. Hunt [11, p. 214], in re- 
viewing the Ellis and Conrad article, further 
elaborated on these points because they are 


generally overlooked. 

In the clinical psychology literature, popu- 
Jation rates of the events under study are rare- 
ly reported or considered, However, the effec- 


tiveness of any method for the prediction of 


the behavior of individuals cannot be evalu- 
at least a rough esti- 


ated properly without ough 
mate of the frequency of the behavior in the 


population being studied. 
Summary 

A number of investigators have proposed 
certain signs and configurations from psycho- 
logical tests for the detection of suicidal pa- 
tients. The purposes of this paper have been 
(a) to suggest greater refinement of the classi- 
fication of patients in suicide research, (b) to 
emphasize some of the limitations inherent 1n 
the prediction of suicide, and (c) to indicate 
the general applicability of such limitations in 
the prediction of any other behavior or event 


of infrequent occurrence. 


Classification of patients in suicide research. 


‘The need for more precise classification ot pa- 
tients in suicide research was emphasized both 
by (a) evidence that “suicidal” subgroups can 
be differentiated by means of psychological 
tests, and (b) data on the low incidence of 
suicide. Suicide is an extremely infrequent 
event, and very few of those patients who are 
severely depressed or who express suicide 
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thoughts or threats actually commit suicide, 
Thus, data from such patients cannot arbi- 
trarily be grouped under the class term 
“suicidal.” It was suggested that in the develop- 
ment and validation of a suicide detection 
device, one criterion group should consist exclu- 
sively of patients who committed suicide and 
for whom test data were obtained a relatively 
short time before the suicide. 


Limitations of suicide predictors. The low 
incidence of suicide is in itself a major limita- 
tion in the development of an effective suicide 
detection device, for in the attempt to predict 
suicide or any other infrequent event, a large 
number of false positives are obtained (patients 
incorrectly classified as suicides). To illustrate 
this point, a hypothetical suicide detection in- 
dex was developed and cross-validated within 
a psychiatric patient population. It was. dem- 
onstrated that such an index would have no 
practical value, for it would be 
treat as potential sui 
ber of false positive 
cutting line of the 


gnosis and the 


many other dia nostic 
groups. (c) It would be more dicate eo ob- 


events of low 
ed to psychometric 
e encountered in pre- 


are not restrict 
prediction, but are likewis 
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diction based on “clinical judgment.” A sul 
cide detection device is not feasible until ie 
more is learned about the differential char: 
teristics of patients who commit suicide. 


ay infre 
Limitations in prediction of other f 


as tec 
quent events. The problem of suicide oa 
tion provides an effective illustration ee, 
importance of considering the fe E 
in a given population of any behavior ond 
which is to be predicted. The kar: in l 
prediction discussed in this paper aPP y roade | 
ser degree to any behavior as its rate app din + 
es .50 in a population dichotomized ac aviot: 
to the presence or absence of the rhe Pt 
The effectiveness of any method for ak be 
diction of behavior for individuals aa > 
evaluated properly without at least aA in the 
timate of the frequency of the behav! 
population being studied. 
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Intelligence Factors in Irregular Discharge | 
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John R. Thurston and George Calden 


VA Hospital, Madison, Wisconsin 


Irregular discharge from tuberculosis hos- 
Pitals is a problem of major medical and social 
importance. For each patient who remains until 
maximum hospital benefit has been achieved, 
there is another patient who leaves the hospital 
prematurely, without medical approval, i.e., 
receives an irregular discharge [1]. This sug- 
gests that the current tuberculosis therapy pro- 
gram can be applied effectively to only half of 
the hospitalized patients. From a public health 
point of view, the seriousness of this problem 
cannot be overemphasized. 

It has often been hypothesized that low in- 
telligence may be characteristic of the patient 
who leaves irregularly. This study was design- 
ed to answer the following question: Are pa- 
tients who leave the hospital irregularly less in- 
telligent than those who remain to receive a 
medically sanctioned discharge? 

The Ss in this study were 182 male tubercu- 
losis patients admitted to this hospital during a 
one-year period. All Ss were given a short-form 
Wechsler-Bellevue during their second month 
of hospitalization, The abbreviated form con- 
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sists of six subtests: Information, Coit Desig™ 
sion, Digit Span, Similarities, Block 1 
and Picture Completion. oi d 0 
The irregular discharge group © the hosp” 
the first 50 Ss in the sample to leave we grou! 
tal irregularly. The regular > ae e wh? 
consisted of the first 50 Ss in the oe dis 
obtained regular, medically app! | 
charges. indicat 
Analysis of the W-B test results a whole, 
that the tuberculosis patient group, 3 io 7 
is of average intelligence (mean f; 
107.59). i res 2 
A = ON of the mean IQ a 5 
subtest scores of the 50 regularly en 48, Fa 
tients (VIQ= 107.72, PIQ= 11A ed fo 
= 110.62) and 50 irregularly were 49 
tients (VIQ = 105.20, PIQ= 10 igih 
= 107.20) reveals no statistically chat’ jj 
differences. These results suggest in inte 
group basis, there is little nen a 
gence between patients receiving ” aa 
irregular discharges. : ations i 
In order to comprehend the reta itis ro 
intelligence to irregular oe on g 
ably necessary to consider the ae an at 
individual intelligence, personality, e 
tional factors, rather than to limit 
tion te IQ scores per se. 
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in Pulmonary Tuberculosis * 
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medical progress ratings, as noted below, were 
independently made by three medical experts 
two years after the Rorschach protocols were 
obtained. 


Procedure 


The Rorschach protocols used in the present 
study were obtained from 45 male, white vet- 
erans hospitalized and being treated for active 
pulmonary tuberculosis at the Veterans Ad- 
ministration Hospital, Butler, Pennsylvania. 
The Rorschach data were originally obtained 
and analyzed by Newton [9] in his compar- 
ative study of the personality traits of patients 
with far advanced pulmonary tuberculosis as 
differentiated from those with minimally and 
moderately advanced tuberculosis. Twenty- 
four months after the original test administra- 
tion, three physicians from the Tuberculosis 
Service of the hospital, upon the writer’s re- 
quest, rated the degree to which the course of 
the pulmonary tuberculosis process in each sub- 
ject compared with the expected course of the 
disease in each case as determined by the entire 
medical history as shown in the medical chart. 
The rating scale instructions were specifically 
as follows: 


“Please rate on the attached scale the degree to 
which the course of the pulmonary tuber ‘ulosis pro- 
cess coincides with that which you would expect that 
disease process to have followed on the basis of the 
entire medical history as shown in the medical 
chart.” The graphic rating scale consisted of five 


serially numbered points defined as follows: “Medic- 
al course much worse than expected”; “Medical 
course somewhat worse than expected” ; “Medical 


course as expected” ; Medical course somewhat better 
than expected”; “Medical course much better than 
expected.” 

In each case, a complete medical chart, 
well as all X-ray plates, were available for an- 
alysis. All ratings by the three physicians were 


as 
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effected in a two-week interval so that an ap- 
proximately equal period of time elapsed be- 
tween the original Rorschach testing and the 
medical rating procedures. The three raters 
were highly competent medical practitioners 
specializing for many years in the diagnosis and 
treatment of tuberculosis. The three raters met 
together, reviewed the medical charts, X-ray 
plates, and other pertinent medical data, and 
each one then independently made his judg- 
ment on the above rating scale. Only those 
cases in which there was complete agreement 
between the three judges were included in this 
study. In each case, all ratings were made 
solely on the basis of the same data. None of 
the judges had close ward contact or immediate 
medical responsibility for the particular sub- 
jects of the study. This control was utilized 
in order to minimize personality bias on the 
Part of the medical raters and to reduce the 
likelihood of their confounding adjustment to 
hospital routine with Progress of the disease. 
The operation of this “halo” phenomenon and 
cautioning against it were Pointed out by Dan- 
iels and Davidoff [4]. 
Analysis of the Rorschach 


done independently of the 
that th 


ical rati 


Protocols was 


Table 1 


Means, Standard Deviations, 


Progress 


Progress Progress 
Worse than 


as betterthan F 
expected expected 


expected 
ae a a 


Variable 


11 
Age Mean 29.94 26.87 25.64 2.42* 
an 734 641 3.40 l 
onths o: ean 15.21 44.97 
hospitali- n Ei 
zation SD 9.45 6.66 
Wechsler- Hi 
Bellevue Mean 22,68 23.53 2 
i a 3.6 
Vocabulary $ =e 
score SD 5.18 5.17 4.25 
2 ee 


* Not significant at the -05 level of confidence. 


David Cohen 


t 
education, Vocabulary score of the wee 
Bellevue Intelligence Scale, marital pee, 
cation, severity of the disease proce 
whether the patient was improving, sr i 
or showing no significant change in his r 
condition. No Ss who showed any agi 3 
pathology at the time of the study a motion" 
history there was evidence of marked € | 
al maladjustment were included. B. 

One member of each pair was dioer 
either a minimally or moderately giva i 
of active pulmonary tuberculosis W e: 
other member of the pair was diagnos peret 
far advanced case of active pulmonary tv alos 
losis. The criteria of the National beg the 
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nique which assumes only that all observations 
are independent; that all observations within a 
given sample are derived from a single popula- 
tion; and that the sample populations are of 
approximately the same form. It makes no as- 
sumptions about scale units and the normality 
of score distributions, neither of which are met 
by the Rorschach data and are required if con- 
ventional additive statistical techniques were to 
be used. A derived H value is treated as a chi- 
square value with the degrees of freedom 
equal to the number of samples being compared 
less one. There is a correction for ties. 


On none of the Rorschach scoring variables 
did the progress groups differ significantly. Ap- 
parently with patients of relatively young age, 
as in the population of this study, who have 
been hospitalized for active pulmonary tuber- 
culosis for a relatively short period early in their 
illness, the Rorschach technique cannot reliably 
predict the rate of recovery at least in a twenty- 


four month interval. 
Summary 

This study measured the ability of the Ror- 
schach technique, singly, to predict two years 
beforehand the medical progress rate of young, 
male, hospitalized, pulmonary tuberculous pa- 
tients being treated early in their illness. Rate 
of medical progress was defined as the degree 
to which a patient’s medical progress conforms 
to his expected progress based on the patient’s 
over-all medical history. None of 33 Rorschach 
scoring variables, nor the Harrower-Erickson 
technique of evaluating neurotic signs on this 
test, nor the anxiety and hostility variables of 
Elizur’s Rorschach Content Test were found 
to reliably predict the rate of medical progress. 
Degree of medical progress was not significant- 
ly related to age, length of hospitalization, in- 
telligence, or severity of the tuberculous pro- 
cess. 
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Previous studies. One of the surprising find- 
ings in a perusal of the literature is the lack 
of prognostic studies of psychotherapy with 
standard psychological tools. The few studies 
that do appear have been more concerned with 
the prognosis of drug and shock therapy than 
with psychotherapy. 

Bradway, Lion, and Corrigan [4] developed 

a prognostic rule on the Rorschach to predict 
the success in therapy of 16 promiscuous delin- 
quent girls. When cross validated on 20 other 
delinquent girls, the list proved to be 80% 
successful in predicting the therapeutic out- 
come. 
Harris and Christianson [12] attempted to 
match the pretherapy test results of 53 non- 
psychotic patients to their success in brief psy- 
chotherapeutic contacts. The Wechsler-Belle- 
vue scale and the traditional scoring of the 
Rorschach yielded no real differences between 
the highly improved group and the less im- 
proved group. The authors extracted Ror- 
schach factors that seemed to be of significance 
in an attempt to form a prognostic scale. Un- 
fortunately, no cross validation was done. Four 
MMPI scales, Sc, Pa, Ma, and Pd, revealed 
significant differences between the groups, with 
high scores being contraindications to a favor- 
able outcome in therapy. 

Barron [2] used the Rorschach, MMPI, 
and the Ethnocentrism scale to compare the re- 
sults of 33 adult psychoneurotics following six 
months of psychotherapy in an outpatient clin- 
ic. Therapists’ and supervisors’ ratings were 
the criteria for improvement. The Rorschach 
revealed no differences between the improved 
and unimproved groups, but the MMPI pro- 
files yielded results that agreed in part with 
the Harris and Christianson study. The un- 
improved groups scored higher on both the psy- 
chotic and neurotic scales on the pretherapy 
tests. The highest single predictor was the Eth- 
nocentrism scale, a high score on the E scale 
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being indicative of poor therapy prospects. Bar- 
ron points out that the ethnic background of 
the therapists in this study might have had 


some untoward influence on this particular re- 
sult. 


Rogers and Hammond [15] obtained a 
sample of 109 patients drawn randomly from 
a VA Mental Hygiene Clinic population. Suc- 
cess in therapy was rated by the therapist and 
senior psychiatrist on the staff. Neither clinical 
judgment on the Rorschach nor the Harris- 
Christianson scoring list showed any positive 
findings. Ninety-nine single variables were also 
examined with similar negative results. The 
only positive finding was the relatively high 
frequency of extensor M responses in the rec- 
ords of the successful group. 


Method 


Subjects. The 76 
study were all 


Measure oo 
Mean pp 
Overt stress 
Taylor anxiety 8.81 
Elizur anxiety 6.31 39 
Mooney problems checked 33.86 Bes 
Productivity ` 
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Ego defense Í 
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2. The Elizur [6] Rorschach anxi¢ 
3. The number of problems checked 
Mooney Problem Check List. l 
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fective was the Barron ego-defense scale, which 
yielded no differences between the Least Suc- 
cessful and Most Successful groups. 

Table 3 shows the mean MMPI scores for 
the Least Successful and the Most Successful 
groups. Analyses of these results by du Mas’ 
methods of profile analysis revealed the two pro- 
files to be quite similar in shape, elevation, and 
scatter. The one difference that is statistically 
significant appears on the D scale on which 
the Most Successful group scored significantly 
higher before therapy began. The author has 
previously shown that this is one of the scales 
most likely to be influenced by contact with 


therapy. 
Table 3 


Comparison of Less Improved with 
More Improved on Pretherapy MMPI Scores 


Less improved More improved 


Scale (N= 15) (N=15) 
Mean SD Mean SD 

F 60.86 8.66 59.67 7.99 
K 54.27 7.56 51.73 6.63 
Hs 56.33 12.54 56.27 13.20 
D 65.73* 10.51 75.07 16.59 
Hy 62.20 12.13 64.07 9.46 
Pd 67.00 13.15 66.40 14.41 
Pa 60.67 8.27 60.40 8.96 
Pi 68.13 13.06 71.20 10.18 
Sc 67.27 13.78 64.93 13.34 
Ma 61.33 13.53 56.60 11.40 

oS O Oo a a 
s Difference significant at 5% level of confidence. 


The present MMPI results differ consider- 
ably from both the Harris and Christianson 
study and Barron’s work. The major pre- 
therapy differences on the profiles are the low- 
er mean scores on the Pa and Sc scales in the 
present study. This result may be due to the 
weeding out of clients with psychosis or psy- 
chotic trends before starting therapy or may be 
due to the absence of those characteristics in 
the present college population. 

Discussion 

The results seem to justify a tentative con- 
clusion that some of the factors that are related 
to clients leaving client-centered therapy are 
also operating to a lesser degree to prevent any 
sabstantial success in therapy itself. Two of 
these factors seem to be lack of overt tension 
and a lack of verbal productivity as revealed 


on the pretherapy tests. An interesting exten- 
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sion of this study would be to compare the re- 
lationship between lack of productivity in the 
tests and lack of productivity in the interview 
situation itself. 


The implications here are that unless the 
client is motivated by some overt anxiety to 
change his perceptions and unless he is able to 
give of his perceptions freely with the counsel- 
or, then client-centered methods of counseling 
will produce a minimum of change whether or 
not the client leaves or remains in the situa- 
tion. This, of course, does not necessarily mean 
that any other therapeutic methods would be 


more successful until evidence is presented to 
prove that contention. 


It occurred to the writer after the data 
were collected that the statistical significance 
of the differences between the Present groups 
on the stated variables depended on some as- 
sumptions that probably were not completely 
met. It is generally assumed that when groups 
are compared on one variable that the other 
relevant variables are either held constant or 
randomized. In the Present case, that would 
mean that there would be as much liklihood for 
circumstances to cause clients to m 
the discontinue category or the least 
category into the most successful ci 
there would be for 
direction. 


ove from 
successful 
ategory as 
them to go in the opposite 


. Although no concrete evidence was available, 


it seems most unlikely that the above assump- 
tion was satisfied. A number iti 


Cases, 


Thus, each of these adverse circumstances, 
present to an unknown degree, would have the 
effect of 


lowering the Probabilit 
statistically significant differences 
inal variable. Therefo 
are obtained should b 
able eye, and the expe 
before throwing out d 
not reach statistica: 


y of getting 
on the orig- 
re, any differences that 
e viewed with a favor- 
timenter should hesitate 
ata that approach but do 
significance under these 
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circumstances. . hat 

It is always well to try to estimate ve tee 
extent the present results can be Ben e dis- 
to other situations. A possible a and the 
agreement between the present Fen an 
previous findings of Barron and o teh the 
Christianson. As has already been IMPI re 
present population, as revealed by 4 
sults, is a rather homogencous ENE a results 

One might conclude that the prese relative 
will hold only if other factors are kept becomes 
ly constant. When the total papa A i 
heterogeneous, such as might be EE ot 
an out-patient mental hygiene clinic, eo under 
factors such as the amount of ae im 
lay, psychopathic trends, etc. may be than th? 
portant in determining prognosis ©. siyity 
amount of overt stress and lack of pro 
mentioned here. 

The next question that needs to be 
is what can be done with the group, 
tially identifiable, that does not see thods © 
Profit very much from traditional oie ruit 
counseling. Here, perhaps, lies the mo: iy ce 
ful area of experimentation and researc 
near future. 


ved 
answel® A 
ar 


Summary ph 


/) 

Results on pretherapy Rorschach, M ; 
and Mooney Problem Check List ontinue 
used to compare 34 clients who dis¢ and is 
15 clients who showed the least ea dlie” 
clients who showed the most gain fro 
centered counseling. 

The findings seem to support the ing t 
that success in client-centered Ceat o ora 
to be positively related to the amou amo"! t y 
stress and negatively related to the “ether” 
verbal productivity shown on the P 
tests. 


siS 


te 
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Implications of the Performance of ies ] 
Girls on the Rosenzweig Picture-Frustration Study 


A group of 95 deli 


Julia R. Vane 


Hempstead Public Schools, New York 


nquent girls and a group 


of 50 nondelinquent girls of similar age, in- 
telligence, and socioeconomic background were 
given the Rosenzweig PictureF rustration 
Study according to standard instructions, 

The delinquents were from a state reform- 
atory; mean CA 18.9 + 1.6, mean IQ 91.5 
14.1. The nondelinquents were from the sixth 


term of a vocational 
=.8, mean IQ 94.2 


Two other studies [1,3] 
subjects wish to make a goo 


duplication Service, Libr 


gress, 


itting in advance $1.2 


Plicatio 


high school; mean CA 16.9 
+6.2. 


indicate that when 
d impression on the 


ary of Congress, Washing- 


s l 
n Service, Librar Parable 


Yy of Con- 


ere norms 
P-F Study, the responses differ from the 


in the same manner as the responses on 
linquents. It would appear cee ee 
delinquents were trying to make a fi 
impression on this scale. : „pressio® 

That this ability to make a good imp on in” 
on the P-F Study is not dependent OF sents 
telligence was revealed when the i the rë 
were divided into two subgroups ae | had 
sults compared. One subgroup (N 50) had 4 
a mean IQ of 79, the other (N= 50 ficant 
mean IQ of 102. There were no signi ihe 
differences between the groups in any 
categories. patter? 

The Possibility that the response general 
shown by the delinguents may be * pack that 
delinquent pattern is suggested by the aan 2] 
the P-F responses of 110 women paa in the 
deviated significantly from the po oe ical 
Same manner and almost to the same 9 na 
degree as the delinquent responses. me 

On the basis of this and other ae a 
tioned [1, 2, 3] it seems inadvisable meer 8 
P-F Study as a means of analyzing P% 
reactions of delinquents. 


Brief Report 
Received June 8, 1954. s 
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Tai . . 
ctual-Kinesthetic Perception as a Technique for 
‘Diagnosing Brain Damage’ 


James W. Parker ° 


Brooke Army Hospital, San Antonio, Texas 


It h 
current tes demonstrated that many of the 
u, 5, 11] s for brain damage are inadequate 
stressing aa though a few, particularly those 
Proved e See aunt performances, have 
al va owt, there are patients 
» but who ty is reported to be satisfac- 
defects in ot experience marked perceptual 
Nery [6], T) ee as a result of brain in- 
bray L p: 47] Ta in view of DeJong’s state- 
sup injured ie the most difficult tasks for 
Ject to reak ients are those requiring the 
adapt to fa from old mental habits 
3 that technig amiliar) situations, it would 
in OP Visual aa placing minimal emphasis 
Svaluating th Ption should be of importance 
di ‘Mae by ee Patients. In addition, the 
alin eat individuals and Lehtinen [13] that 
S in their fos ee alent sense mod- 
Pairme Patient, whil ay living. onld sugges 
nt, could ma i actually suffering im- 
those tasks Teaia est a “normal” perform- 
podalities he primarily the use of 
Gj, ePout his life. ` ať he had emphasized 


Whose visu 


Seem 


his Patients 


Teg Sphe 
arch» E [4 9 14] 
wa in the are, 1 , carefully controlled 
e at of a gs 
tan Gra diss, . 
odida atate Seha on presented to the Faculty of 
fore autho, T the D of the University of Texas in 
(ip Phi? Wishes eee of Doctor of Philosophy. 
of pe eet Worch ia express his thanks to Frofes- 
Q ‘Ychole and Lloyd ayne H. Holtzman, Hugh 
Meres S. 7 Caveat ree of the Department 
ig ection, pesoni, U exas, and to Colonel 
4 Westie Toughout th: peek for their helpful 
th ‘At tion, e design and execution of 


ig 
tese, alter R 
arc] eed ” 
h was e i Medical Center when 


tea has been meager. The few 
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studies have been in most instances of limited 
application, either because of experimental de- 
sign or the specific nature of the investigations. 
In some of these studies the patients have been 
inadequately diagnosed; in others, controls 
have been lacking or not comparable with the 
experimental subjects. In the main, these stud- 
ies have been applied to special groups, such as 
young children or mentally deficient adults. 
Strauss and Lehtinen expressly state that 
«|. although a comparative psychopathology 
of brain injury in children and adults shows 
many identities, some features . . . are manifes- 
tations of childhood” [13, p- 117] and that 
final conclusions regarding perceptual disturb- 
ances cannot be drawn because comparative 
studies with their tests, some of which accent 
tactual-kinesthetic performances, have not been 
made. 

It was the purpose of the present study (a) 
to determine whether there is a significant dif- 
ference in tactual-kinesthetic performances of 
brain-injured and non-brain-injured patients, 
(b) to investigate the possible relationship be- 
tween tactual-kinesthetic task performance on 
the one hand, and the site and extent of the 
brain lesions on the other, and (c) to compare 
the patients’ tactual-kinesthetic performances 
with their Bender-Gestalt test performances, 
emphasizing the relative discriminative power 


of the two types of measures. 
Subjects 


The experimental group consisted of -thirty 
adult male hospitalized patients with definitely 
diagnosed brain injuries of fairly recent origin. 
Most of them had been injured within six to 
ten months of the time of this study. They 
ranged in chronological age from 21 to 48 years, 
with a mean age of 25 years. Their ment 
ages, obtained from the Shipley-Hartford Re- 
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treat Scale, ranged from 9 years, 6 months to 
18 years, 7 months, with an average mental age 
of 14 years, 1 month. Patients with gross 
sensory and motor defects on the dominant 
side, neuropsychiatric patients, the noticeably 
mentally deteriorated, and patients with severe 
visual defects were not included in the investi- 
gation. 

The control group of 30 adult male patients 
who revealed no evidence of brain damage was 
drawn at random from general medical hos- 
pital wards. They ranged in chronological age 
from 19 to 40 years, with an average age of 
23 years. Their average mental age was 15 
years, 2 months and ranged from 10 years to 
18 years, 7 months.* 


Procedure 


lieved to alleviate an 
of which were “org: 
organic” records, t 
according to the 

Suttell [12]. To 


Gestalt test, 


Following the Bender- 
ter testing each individ 
ability by having him ide 
Perceived objects, Ss w 


S Was i i 
cant at the .05 level of confidence. netslanih- 
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example, was found to be of equal difficult 
with a “9”. In the present experiment me 
each pair of these equated patterns had j ra 
ground of thumbtacks, to determine W B 
the brain-injured group would ay 
greater difficulty than the controls in er 

tiating the figures from their backgrounes: 


siii as 

With the boards hidden from the S's vier oat 
asked to explore their surfaces with his he felt- 
hand until he was prepared to draw what plored 
It was stressed that the surface should be & repro” 
only as long as was necessary to be able y was o 
duce it accurately, and that while accuracy, woul 
first importance, time was being recorded an de 


o 
cii sted to; 
be considered. Furthermore, S was reque: reeling 


scribe the various surfaces while he w ente! 
them, and to make any comments that ae nota 
his mind. Verbalizations were recorded, a proach 
tions were made concerning the manner © 
employed by S. ted for all 

When the first procedure was comple sented t? 
the stimuli, the entire series was again aes asked 
S, in the same manner except that he was antl 
to reproduce the surfaces, but to feel them 


> awings 
was ready to choose from a series of dra oret 


od exP 
one most nearly like the surface he hed f 


ing without the background represente incorre? 
choices consisted of drawings wherein r ack®' 
figure was made with dark spots representi straight 
and finally there were choices with neor Kae 

line figures on backgrounds representing © 


an 
ew auss * 
Methods similar to those of st to co™ 


Lehtinen with children [13] were use rim ptal 
pare the drawings made by the expe™ ș phe 
grouþ in the present study with thor gwing 
control group on the basis of the = raw 
criteria: (a) the number of straight-li® A 
ings versus the number of drawings rawing 
ing thumbtacks, (4) the number of 

with only circles of the background, 
number of drawings with only the an 3 
well as the background, and (d) the o W 
of figure rotations. In addition, 1 aw” 
vesti¢ators independently rated eac rating 
ing on a scale from zero to five- nost K 
of five was given to drawings ie a 
curately representing the stimulus Ea repr 
a rating of zero for the most inaccurate n 
sentations. In order that the judges Ti of * 
know whether they were rating the re“ 


—————————— a 
ai ate or 


brain-inj . 

ee es or of a control S, all identifying 
shuffled n agen and the records were 
Barman bae the rating procedure. The 
two raters Sao r eliability coefficient for the 
ividual deni ; 8. i he ratings í signed to in- 
Separately Pr by each judge were averaged 
Was an Se f ` the mean of the two averages 

s final total drawing score. 


It w 
as 7 ; 
fully realized that the brain-injured 


S of thi 
study were not ideally suited for the 


‘NVestigati 
tion, The of the effects of cortical localiza- 
sions all nous iran and extent of such 
evertheless, ce impossible to determine. 
US studies ffi Na of the arcity of previ- 
€ data to in Jee bila 1G YEH decided to use 
tactual-kines “TE sed effects of localization on 
Cases, Geen performances. In all but four 
ormed, the be _craniotomies were not per- 
“ated on a cl ten surgeon or neurologist indi- 
Ne brain beh’ as well as he could ascertain, 
S Were dj ag involved in each lesion. The 
Site vided into groups according to the 
wl ions, and analyses were made to 
aud ar certain brain areas were 
`: mance, Finall S to tactual-kinesthetic per- 
Bnificant ally, the data were examined for 
$ “nt relationships hetween the extent of 


€ le 
sions 
san á 
and the degree of disturbance noted. 


R . 
esults and Discussion 


ys 
fan score (anor Gestalt Test. The 
en Cone brain-injured group on the 
trols war os WAS 42.4, while that of the 
te secs difference of 16.1 be- 
Star the .01 le s is statistically significant be- 
Ntiating the vel of confidence, thereby sub- 
at dam assertion by Pascal and Suttell 
Scores on th age to the cortex results in high- 
í en the ka Bender-Gestalt test. 
; Utting aea edian score of 28 was used as 
ed Stroup fell 72.4 per cent of the brain-in- 
= of the uni above this point, and 36.6 per 
ing score np ured scored higher. With 
ain-injureq a moreover, 48 per cent of 
N uP, and 10 s were included in the high- 
ot all per cent of the uninjured. 


Bender 


Clinic 
a 
lly apparent “organics.” Some of 


arno vould 

of stie Bob ely have constituted di- 

dogg Umiatic rai wire it not for their history 
t corro Tain inyury. This observation 
orate the comment by Pascal 


a 
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of 
the very high-scoring patients- 
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and Suttell that only in extreme cases, which 
are also clinically apparent, can the Bender- 
Gestalt test answer the question: “Does the 
psychological record show signs indicative of 
damage to the cortex?” [12, p. 40]. 

Object-recognition test. Because the two 
groups could not be significantly differentiated 
on the basis of their ability to recognize nine 
different objects by the sense of touch, it would 
appear that tactual acuity in the brain-injured 
group was not seriously impaired, and that 
astereognosis was absent. 

Analysis of the drawings. On the basis of 
the scores assigned to the various drawings of 
the stimuli, the experimental and control 
groups were differentiated beyond the .01 level 
of confidence. With the median of 35 as a cut- 
ting score, 76.6 per cent of the experimental 
group were included in the low-scoring half, 
and 26.6 per cent of the controls; 75 per cent 
of all Ss would have been correctly diagnosed 
on this basis. A cutting score of 27, moreover, 
included 46.6 per cent of the brain-injured Ss 
and 10 per cent of the uninjured. 

Although the Bender-Gestalt test approach- 
with the median as a cutting 
one brain-injured S not 
scoring below the median on the tactual-kin- 
esthetic drawings. Low tactual-kinesthetic 
drawing scores, however, included three brain- 
injured Ss not suggested by the Bender-Gestalt 
scores. The coefficient of correlation between 
the Bender-Gestalt and tactual-kinesthetic 
tests was -68. 

Unlike the reactions of the brain-injured 
children studied by Strauss and Lehtinen [13], 
the adult brain-injured Ss of the present study 
could not be differentiated from the control 
group on the basis of (a) the number of Ss 
who drew straight-line forms; (b) the num- 
ber who drew only the circles of the background ; 
or (c) the number who drew the figure as well 
as the background. The reason these results are 
so different from those found with children 
may be accounted for by the assumptien that 
perception in children differs from that in 
adults, and that, as Hebb postulates” . . - an 
early injury may prevent the development of 
_.. capacities that an equally extensive injury, 
at maturity, would not have destroyed” [0, p- 


292). 
When the drawings were analyzed for 90 


ed these results, 
score it detected only 


& 
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and 180 degree rotations from the true orienta- 
tion of the stimulus figures, it was observed 
that rotation occurred in the case of eight 
brain-injured Ss and only one control S, the 
difference being significant at the .02 level of 
confidence. Were this trend to be borne out by 
further investigation, rotations on this task, 
as on the Bender-Gestalt test [3], may prove 
to be an important pathognomonic sign. 


Reaction times. Although the brain-injured 
group scored lower than the control group on 
their reproductions of the tactual-kinesthetic 
stimuli, these injured Ss had far more objective 
experience with the task. Whereas this group 
averaged 2.07 minutes per surface, the unin- 
jured Ss explored each surface on the average 


of only 1.35 minutes—a difference significant 
at the .02 level of confidence. 


Allen and Krato [2] have speculated that 
the knowledge that he is being timed may ex- 
acerbate the brain-damaged patient’s anxieties 
relating to his physical disability and serve to 
disrupt any train of organization, and that 
such disruption of an already impaired organi- 
zational capacity may well cause slower re- 
action times in the brain-injured. In 
nection Goldstein maintains that brain damage 
“causes a rise of the threshold, and retardation 
of the excitation” [7, p. 599]. There occurs, 


he states, a reduction in receptivity, causing 


the patient to take much more time to react. 
Furthermore, t 


he apparent need for several of 
the brain-injured Ss to count each individual 
thumbtack even when advised that this was un- 
necessary ma 


y have been what Strauss and 
Lehtinen have described as“... a 


adaptation to order the external 
a way that a 
satisfaction of 


this con- 


unconscious 


world in such 
Positive result, and with it the 
achievement, can be obtained” 


-O1 level of confidence. The nature of the 
drawings undoubtedly created particular diff- 
culties for each group. The Ss had to decide 
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what was most essential in each Spee, o 
the accurate representation of a figure S 
with a straight-line drawing, (2) an ‘ol ee 
figure consisting of dots aS eo 
(c) an incorrect figure having ak a 
representing tacks. It was though 4 
latter two types of responses were more F 
in nature and might, thereby, be a 
frequently by brain-injured paims, r 
to this expectation, however, only 6 Pa ices 
of the brain-injured patients’ incorrec P 
were of the “concrete” type, whereas injure? 
cent of the incorrect choices of the H fai ed 
patients were. This analysis, thereto of a 
to reveal any particular concrete mo 
proach that these brain-damaged pat! 
have been experiencing. 
Comparison of thumbtack-back “i 
sus smooth-background stimuli. Fou’ s¢iculty 
stimulus figures had been equated for vas BY 
with four others, and one set of cit flat 
en a background of randomly embe eft with 
thumbtacks while the other set was Ie | 
The performance? 


la „ed 
s : : on analy?” 
on these two sets of stimuli were ther r 


oncrete 
e more 


ver 
ground he 


with 


$5 


Be fe ter difu gure? 
nijured Ss experienced greater the ti 
h dive : - tiating an 
the uninjured in differen "e no WE ar 
from their backgrounds, and while ™ E 

i 


t that the | 
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appa . 
ee they could not perform at all 
rew individe i several of this group literally 
attempted re 1a thumbracks in profile in their 
able to ATE n seemingly being un- 
into an inte Er the separate aspects of a figure 
Prehension F P A whole. The immediate ap- 
Peared to be si this situation for these Ss ap- 
this ig P A AT in a board, and 
at bratacds ey drew. Goldstein emphasizes 
te amaged patients cannot transcend 


this « 

>o Mmedi A 
thing or Sey apprehension of the given 
[8 ya tUation in its particular uniqueness” 


T. 3 

Causes Ge ont tint shite concrete approach 
Claims SiE e “directed by the immediate 
ike a A particular aspect of the ob- 
Maintains Rait [8, p. 3]. Furthermore, he 
Ness exerts a ecause this experienced unique- 
Practically ia emands upon the patient, it is 
Mons Gee for him to realize other 
example öt he object, or to think of it as an 


repres ; 
presentative of a larger whole. 


= Sipe of the brain-injured Ss’ per- 
í 1n silent while marked tendency to re- 
» in spite of i exploring the various sur- 
examiner whe he repeated instruction to tell 

3 Seemed that tever came into their minds. 
tep retive the Sis of these Ss were unable 
Ce at they y imuli and, at the same time, 
x hee too, has b vere doing or thinking. This 
ing, py Mes ie observed by Goldstein [8], 
ia © asserts naer disturbances in abstrac- 
ances for the ti a the more difficult per- 
are sed that the rain-injured are those which 
than ou and eee, account of what they 
€ not <a tasks will suffer more 

g reflection. ‘ 


Fee dyshu nines 
ace unction „listed by Goldstein 
8 on Dances Some in part for many of the 
‘ves the tatuat kia by the brain-injured 
acts tigation; a inesthetic tasks of the present 
an rae Oneself; y an inability to “account for 
Vario ability o ie verbalize the account,” (6) 
the Aspects,” an d in mind simultaneously 
Riven Sentia] of and (c) an inability to “grasp 
ine Een whole; to break up a 


Siz ‘ol 
e them” e int 


Loca 
dra, cal 


Another 
rmances 


lran zati + Di 


0 
toug E es on extent of lesions. The 
Boripe? macrose the patients whose lesions 
accordi opically localized were cate- 
ng to the brain areas involved. 


o á 
Parts, to isolate and to synthe-: 
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Because there are so few cases within each 
category, statistical analyses of the data were 
limited. The mean score for those whose lesions 
involved the parietal area was compared with 
the mean for those whose lesions involved 
frontal areas, and the difference between 
these means was not significant. In order 
to determine if there was a relationship be- 
tween drawing scores and whether the lesion 
was in the dominant or nondominant cerebral 
hemisphere, the average score for patients whose 
lesions were in the dominant hemisphere was 
compared with that for patients who had le- 
sions in the nondominant hemisphere, and the 
difference also was not significant. 


Finally, to see if tactual-kinesthetic drawing 
scores were related to extent of brain damage, 
the records were divided according to whether - 
the injury was large or small. Lesions which 
appeared to involve more than approximately 
one-fourth of one hemisphere were considered 
to be large, and those involving less were con- 
sidered small. The average score for patients 
with large lesions was 22.3, and for those with 
small lesions, the average was 31.7. Although 
there was a difference of 9.4 in favor of the 
latter group, this was not significant even at 
the .20 level of confidence and, therefore, could 


easily have occurred by chance. 


Summary 


The purpose of this study was (4) to investi- 
gate the performances of brain-injured patients 
on tactual-kinesthetic tasks, primarily to dis- 
cover whether such techniques could be used to 
differentiate brain-injured from non-brain-in- 
jured patients, (b) to determine if there is a 
relationship between tactual-kinesthetic task 
performance on the one hand and the site and 
extent of brain lesions on the other, and (c) 
to compare the patients’ tactual-kinesthetic per- 
formances with their Bender-Gestalt test per- 
formances, with particular emphasis on the 
relative discriminative power of the two types 
of measures. 

Sixty hospitalized adult male patients were 
examined, half having brain injuries of fairly 
recent origin and half revealing no evidence of 
neurological involvement. Following adiainis- 
tration of the Bender-Gestalt, and after ex- 
amining each individual for stereognostic abil- 
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ity, the Ss were administered the tactual-kin- 
esthetic tasks. The materials for these tasks 
consisted of 14 wooden boards with various 
patterns on them made up of partially raised 
thumbtacks, some with smooth backgrounds, 
and others with backgrounds of thumbtacks 
randomly embedded flush with the boards. 
With the boards hidden from the §’s view, he 
was asked to explore their surfaces with his 
dominant hand, to tell whatever came to mind, 
and then to draw a picture of what he had 
felt. 

Although both the Bender-Gestalt and the 
tactual-kinesthetic techniques significantly dif- 
ferentiated the two groups, the latter technique 
appeared to offer greater discrimin: 
differentiating the brain- 
jured subjects at highly 
the basis of the followin, 
assigned to drawings of 
time consumed j 


ative power, 
injured from unin- 
significant levels on 
g criteria: (a) scores 
the stimuli, (b) the 
n exploring the various sur- 


No marked relationships were noted between 
tactual-kinesthetic task performances and the 
location or extent of the brain lesions. 

Received April 13, 1954. 
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Hospital and to the VA, 


Meltzoff [4]. Instructions emphasizing (a) 
“real feelings” and (b) speed are commonly 
recognized. These two kinds are studied here 
in relation to their effect on productivity of 
hypotheses for the test as a whole. 


Procedure 


Gonstruction of test. Sixty-five stems were 
chosen for the test. This seemed to be the maxi- 
mum number a hospital patient could complete 
in one session without undue effort and fatigue. 
Forty stems were taken from the Rotter In- 
complete Sentences Blank, Adult Form, be- 
cause a great deal of research has already been 
done on them in other situations. The remain- 
ing 25 stems were created to secure further in- 
formation about ward adjustment of patients,? 
patient identification, and the utility of stems 
using the third person pronoun. 


Two different sets of instructions were used. 
They were alternated from patient to patient. 
One set emphasized speed and the other em- 
phasized “real feelings” as in the Rotter ISB, 
as follows: 


Set S. This is a test of your speed of thinking. 
Complete the following sentences as quickly as you 
can. Write down on each line the first idea that oc- 
curs to you. It makes no difference whether the 
statement you write is true or not, Do not start un- 
til the examiner tells you to begin. 

Set F. Complete these sentences to express your 
real feelings. Try to do every one. Be sure to make 
a complete sentence. 


With the subjects who received the speed in- 
structions a stop watch was used as a prop. 
The order of the sentence stems, as well as 
the instructions, was varied from subject to 
subject. The stems were reproduced on five 


2Another study is being planned to investigate 
the use of the SCT in predicting ward adjustment. 
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pages, 13 stems to a page. The order of the 
Pages was systematically alternated through- 
out both subject samples. By this means the 
subjects, and the clinical judges also, did not 
consistently respond to the same stem order on 
every test. For the second sample of 30 sub- 
jects the stems were reshuffled and a new or- 
der was arranged on each page. This complete 
rearrangement of stem order was made to pre- 
vent context variables from affecting the re- 
sults, 

Subjects. The SCT’s, thus constructed, were 
administered to 60 patients soon after their 
admission to Chillicothe VA Hospital. The 
subjects were divided into two samples of 30 
each (Sample A and Sample B). No regard 
was given to the reason for admission or the 
diagnosis. If a patient was too disturbed or un- 
cooperative to complete as many as 55 of the 
65 stems, he was not used in the research, 


Judges, After the Protocols had been com- 
pleted by the Patients, 


o judge judged pro- 
h Sample A and Sample B, 


' Results 

From the lists o 
turned by the judg 
Judge used each 


f Personality inferences re- 
es the number of times each 
stem was tabulated, No atten- 

3Among these 39 judges, 7 called 
psychcanalytic; 13, modified, broad, 
psychoanalytic; 8, eclectic; 4 


their approach 
eclectic, or neo- 


ş Si > learning or social 
learning; 3, Sullivanian ; 1, Jungian; 1, client-cen- 
tered; 1, neo-Adlerian; + 


» Perceptual-cultural, 
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The number of times an individual Eo 
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references to all stems. The ke i protocol to 
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The weighted scores were hath Samp 
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best stems in Sample A, 44 we different? 
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siderably below the correlation which ior 
thus indicating that some ee were © e 
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productivity and optimal test 
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1, 
A People who push me around 
an y greatest worry 
a Y Greatest fear 
a like to break 
A arriage 
A he only trouble 
A he future 
j: 9. ometimes 
poy. S mind 
| a PI try to 
i Suffer 
A I like 
14 A mother 
ae I need 
* 4 am ver 
ie I failed 
ey I can’t 
5, Other People 
20, 7 ost women 
21, p Secretly 
22, 7 ¥ father 
23, Tegret 
24, 
25 People 
* She 
26, He i 
2 
Be Tam best wh 
Be That nee 
30, I fee] ‘ 
31 What an 
32. Fightin, ‘pee’ 
33. hen I A 
should s a child 
3 Ne ha e 
F a eae time 
Wa 
a wish aang 
39, I i Pains me 
40, Th Ould obey 
K © best 
2, Aat Worri 
a A Nerves ie aren 
n 
45, My friends 
A bedtime 
6 
` Ba 
7 Ga home 
49 Tel 
sy IE 8 the truth 
. Th 
Sky his Place 
52, 2 the 
3 They nr 
Ji i 
a4, D Schoo] 
SS. ancing 
56, She Need, 
iy Ings 
They -Past we 


61. Negroes 

62. It seemed very 
63. Reading 

64. Where I worked 
65. Sports 


The final step in the analysis was to com- 
pare the “real feeling” instructions with the 
speed instructions in terms of total test pro- 
ductivity. The difference was not significant. 
However, the design did not permit compari- 
son of instructions from ratings by the same 
judge. This finding, therefore, may have re- 
sulted from uncontrolled judge variability that 
masked real differences between instructions. 


Discussion 


In general, the results have supported the 
hypothesis that there are consistent individual 
differences in the productivity of sentence com- 
pletion stems. The choice of stems for a test 
does make a difference as to how valuable the 
test is in sampling behavior. The correlation 
of +.745 between stem productivity scores of 
two subject samples attests to the consistency 
with which some stems are more productive 
than others. 

By setting the cutting point at 45 and drop- 
ping the poorest 20 stems we derived a test 
form that seems to be of appropriate size for 
personality evaluation in neuropsychiatric hos- 
pitals. It extracts a good deal of information 
from the average patient without becoming a 
burdensome task. Nevertheless, the test size 
could be shortened or lengthened to meet the 
needs of the individual clinician. For a short 
screening blank the first 15 stems could be used. 
Ten of the first 15 stems in Sample A were 
among the most productive 15 in Sample B. 
The test could also be used flexibly as a time- 
limit rather than a work-limit test. The patient 
could start at the beginning and work until it 
is convenient for him to stop. 

In this empirical investigation there arises 
the question of what qualities make a stem pro- 
ductive or nonproductive. To pursue this ques- 
tion, the first ten stems may be compared with 
the last ten stems in the above list. It appears 
from examining these extremes of productive 
and nonproductive stems that no single factor 
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differentiates the two groups. Many of the 
good stems refer to the first person (I, me, 
my), whereas many of the poor stems have 
third person or impersonal references. Also, 
the poor stems often refer to activities with 
little “emotional” involvement. The good 
stems, on the other hand, are often built around 
hostilities, worries, troubles, and fears. Finally, 
the poor stems refer more often to past situa- 
tions, whereas, the productive stems deal more 
with the present and the future. 

It is interesting to note that the SCT does 
not appear to be a fertile technique for investi- 
gating past and childhood experiences, Not on- 

y are past tense references prevalent among 
the poor stems listed above, but stems such as 
“Back home” and “When I was a child” are 
low in the list. Whether it is because of the 
patients’ ability to respond, the interests of the 
clinician in using the test, or the inherent na- 
ture of the stems, it seems that the SCT in the 
hospital situation is more fertile in s 
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2. A test of 45 highly productive stems ve 
devised as appropriate for psychological oy, 
ation in neuropsychiatric hospitals. E 

3. Results suggested that many of t ee 
productive stems referred to the = D ae 
the present and future; and “emotior 

ects of the subject. 
i 4. No derece was found betwee ect to 
and “real feeling” instructions with resp 


test productivity. 
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instrument would therefore seem best reflected 
by some measure of the number of correct in- 
ferences arrived at by the clinician. The pres- 
ent paper is the report of a study of the valid- 
ity, as just defined, of the MMPI. 

It is obvious that an index of validity as 
described above will vary with the clinician 
who does the interpreting and that no unique 
figure will be obtained. The authors have sug- 
gested in a previous paper [1] that the central 
tendency of such indices among competent 
clinicians interpreting a variety of subject pro- 
tocols might be considered the validity of the 
instrument itself. In this study, the results for 
a number of interpreters working with a single 
protocol are presented. They indicate only what 
can be achieved and not necessarily what 
might occur with other protocols. In addition, 
the results were examined to determine the 
types of inferences made on the basis of the 
MMPI and the relationship between the resul- 
tant types and their accuracy. 


Procedure 


The general procedure has been described in 
more detail elsewhere [1] and is presented 
here in synoptic form. 


Eleven psychologists, competent in the use and 
interpretation of the MMPI and accustomed to writ- 
ing psychological reports from it, were presented 
with the MMPI profile of a subject identified to 
them as male, age 25, and single.2 On the basis of 
the information conveyed to them by this profile, 
each made a Q sort [3] of 150 items of personality 
description. The continuum was from “Most True” 
to “Most False” for the subject. The items were 
a stratified sample from a total item popuiation of 
1604 items abstracted from 17 psychological reports 
written about the subject on the basis of his TAT 
and MAPS test protocols. The 1600 items covered, 


2The test materials and case history data of the 
subject are presented in Thematic Test Analysis 


[2]. 
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so far as could be determined, the usual aspects of 


psychological functioning presented in psychological 
reports. 


The intercorrelations of the distribution of 
items for the 11 MMPI judges are presented 
in Table 1. 


Table 1 
Correlations among the Q Sorts of 11 MMPI 
Interpreters* 
Inter- 


preter 2.3 4% s 6 F sg gy 10 11 
63 62 50 65 73 56 68 64 56 67 
68 56 62 66 51 68 72 61 55 

62 56 50 55 64 68 51 49 

48 45 52 60 66 47 49 

68 42 72 51 67 62 

54 63 61 61 67 

50 64 43 4g 

60 66 56 

52 55 

58 


NYAUPHw 


= 
ovo 


* Decimal points omitted. 
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11 MMPI judges were correlated with 
composite criterion Q sort. 


Results 
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judge with the domain of which he is 4 Feiss 
ber is analogous to a factor loading 1n 7 monë 
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r ast b : $ 
The right rormal intelligence. 


Mo 

st F, . 

€ does not alse items for cluster A were? 
have much anxiety. 


e abl i P 

atherapy with e to progress satisfactorily in 
for pjp bation orea excessive support. 
ea 5 

m ates no psychological problems 


Were 


, e se 
ing ems little cå 
z coreerrik > š à 
erred with his bodily well-be- 


“is ideati 
a ation is not paranoid 
e i i 
a Most True i 
An aa Pears to be a 
i The rss break with. 
i disor al picture is c 
© colon E? with 
oring, Poten 


tems for cluster B were: 


olitary person. 

reality has probably occurred. 

Onsistent with a schizophren- 

© avoid tial paranoid and hebephren- 

H Ctivity, Social disapproval by engaging in soli- 
ging in soll 

S never leat i 


n avoidant ned to solve his problems by 


means, 

ever ans: 
n; Most paa learned social ¢kills. 

e alse i 

mr ‘pears to ni e items for cluster B were: 
D ee Withdrawa 
eacti 5 
i Te hae iene to f 
He MDL Ises 
has the 


outgoing person, 
al is a relatively unimportant 
keai rustration. 
Š 5 
t feelings concerning his aggres- 


well- . = 
Preserved mind of a person who 
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is not psychotic. 
He is probably not disoriented. 


The Most True items for cluster C were: 


He perceives the world as consistently unloving. 
He has marked guilt feelings. 

His guilt feelings may overwhelm him. 

He feels deprived of the oral gratifications of 


childhood. 
He suffers from feelings of rejection. 
In fantasy he longs for kind parents. 


The Most False items for cluster C were: 


He feels generally that he is master of his own 
fate. 

He has little orality. 

His superego is relatively mature. 

This technique of identification emphasizes 
differences among the clusters; the actual high 
degree of agreement is apparent from the cor- 
relations among the cluster domains (Table 3). 
However, inspection of the cluster-identifying 
items suggests that the judges of cluster Ahada 
slight preference for emphasizing the nature of 
the conflicts (over sexual impulses) of the sub- 
ject; the judges of cluster B had a preference 
for emphasizing the primary defenses (with- 9 
drawal) of the subject; and the judges of clus- 
ter C had a preference for emphasizing the 
affective reactions (feelings of rejection) of the 
subject. All are describing a person who is es- 
sentially schizophrenic. 

The right-hand column of Table 2 gives the 
validity figure for each judge in the form of a 
correlation with the composite Q sort described 
previously. The mean value of this validity 
figure for cluster A was -72, for cluster B, .67, 
and for cluster C, .63, with an over-all value 
for the 11 judges of .67. An analysis of variance 
indicated that the differences among the three 
clusters were not significant. 


Discussion 


The data presented above indicated that sub- 
stantial agreement may occur between descrip- 
tions of an individual based upon his, MMPI 
profile and those based upon an elaborate clin- 
ical history. The degree of agreement can be 
emphasized by pointing out that the average 
general factor loading (or correlation with the 
criterion) of the criterion judges themselves was 
only .74 [1] as compared to the average of .67 


for the test judges with the composite criterion 
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Q sort. Moreover, the former figure is a corre- Three clusters of judges could be ee 
lation with a criterion of unit reliability where- among the 11 judges used in this study, but A 
as the latter is with an estimate of that criterion differences among them do not seem to bee 
only. Correction of the average validity figure lated to their over-all validity. I his er 
of the MMPI judges for the unreliability of follow logically from the discussion set ant 
the “true” criterion estimate would further above. The variations in description Tepe 
decrease the difference between the two figures different emphases upon certain aspects © s 
cited. same disorder rather than disagreement the 

Certain cautions need to be kept in mind in diagnosis. Thus the average validity © 

evaluating these data, however. The results in- three clusters is about the same. 


z é is that the 
dicate only what can be done by competent A final conclusion from the study 1S seit y 
clinicians with a specific protocol and not what Q technique has considerable value in P tech- 
might occur with different interpreters or with of the reliability and validity of clinica sults 


the same interpreters and different protocols. niques. It permits the quantification oi $ i 
The subject used in this study presented an without loss of the idiographic A " 
ambiguous clinical picture at the time of testing characteristic ideally suited to clinical re 

but his MMPI profile appears to be anything g nar 

but equivocal (see Table 4). A strong possibili- amps me e de f 
ty exists, therefore, that the comparison of the The validity of ihiferenuee si reter 
MMPI Q sorts with the criterion Q sorts test- MMPI was tested using ah wo, he M 

ed the agreement of two sets of statements about lation of 11 experts working we i n was th 
a certain nosological classification rather than Profile of one subject. The S eet o 
inferences about a specific person.? One critic Consensus, in the form of a general 1 on the 
29 clinicians who Q sorted 150 items 


rom the 
popu 


he 
© Table 4 basis of a comprehensive clinical record A 
MMPI Scores of the Subject same subject. A cluster analysis of er ater 
Scale Raw score Standard score af intercorrelations among the oe ‘These 
? 68 an Preters yielded three groups of Hi the Most 
L Z 43 groups were described in terms © eculiat 
z 13 73 True and Most False Q-sort aa MMP! 
Hs bs 46 to each cluster. Validity figures for cae with # 
D 36 a judge were computed as — criterio 
o 35 a weighted composite Q sort of exit that 
Mf 27 79 Judges. The general résulvs 5 of com 
Pa a 80 MMPI interpreters can achieve aN 1 po” 
Pi Pe 88 sensual validity on the basis of the aa acto 
ie 49 i file approximating the average genera, qu- 
a 


ertain 


z loading of the criterion judges. C presented 

a mamaa ae tions in interpreting the results were ‘equivoc? 
as to sugge e 1} s . ather ul $ se 

merely demonstrate th seest that the data especially in the light of the r in this @ 


: th 
€ existence of a common "ture of the MMPI profile used 19 
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T jis j 
he Validity of Taylor's Manifest Anxiety Scale *’ 
Edward Kendall i 


University of Pittsburgh 


The : 
manifest anxiety scale (4 scale) was 


derdo 
vesti ped by Taylor [16] as a part of an in- 


estigati 
eye ia ie the relation between anxiety and 
Timental st in order to discriminate ex- 
Continuum T, jects on the manifest anxiety 
Items from aylor selected approximately 200 
ality a Minnesota Multiphasic Person- 
to clinical ‘ory (MMPI) and submitted these 
Select Gee with the request that they 
lative of items which they judged to be in- 
finition * manifest anxiety according to & 
Whic ere niea them. The 65 items on 
Were included in. 80% agreement or better 
"evision the scal, the scale, although in a later 
items [14 a was shortened to 50 scored 
2 the dssdo or a more complete description 
he reader i pment and revision of this scale 
Scale has referred to Taylor [17]. The 4 
Rations of ie Sham been employed in investi- 
co, 810, LE learning phenomena [1, 
ie lusions ead : 13, 15, 18], and important 
a US, a serio een derived from these stud- 
sej Teterminati Js problem would seem to be 
Cale ag tee of the adequacy of the A 

x Se of manifest anxiety. 

on Eten 3 : the 4 scale has been shown 
sat, 2E to the m a 96 [6, 14, 16, 17], ac 
beg, © conclu Kes employed, and thus it 1s 
th th emonstrated at adequate reliability has 
reari on The outstanding deficiency 
with the 4 scale to date is the 


p 
tom th 
e 
This Veterans Administration. 
fujgPaPer i 
a iene pee bn a thesis submitted in par- 
Er of scien e requirements for the degree 
s indebteds, The writer wishes to acknow- 
suggested thy to Dr. A. W. Bendig, who 
er membe the area of investigation, and to 
Btatitud; 1 as his committee, Drs. 
holdt is also due Goodman. A special note o* 
the aust at the VA's Dz. Ralph Simon, Chief Psy- 
Stallation at Hospital, Butler, Pennsylvania, 
which the study was carried out. 


of evidence concerning its validity. As 
originally developed and used by Taylor the 
scale was not validated against any criterion of 
manifest anxiety external to the test itself. 
Taylor [17] has recently taken the position 
that the items of the scale may be regarded as 
an operational definition of manifest anxiety. 


However, if anxiety is regarded as a state 


manifesting itself in a wide variety of behavior, 


and if the 4 scale is conceived of as a means of 
tapping such a state, then external validation 
is clearly required. The need for external vali- 
dation is even more apparent when some of the 
assumptions of self-report tests arc considered. . 
Cronbach has pointed out that “the crucial 
assumptions involved are that the subject is 
willing to tell the truth to himself and to the 
investigator, and that the subject can deter- 


mine the truth” [3, P. 307]. 
The currently available studies with the 


A scale provide conflicting evidence as to its 
validity. Rosenbaum [12], in the process of 
studying anxiety and stimulus generalization, 
found that a division of his subjects into high- 
and low-anxiety groups by means of the Æ scale 
and psychiatric ratings gave similar results. 
These apparently positive findings as to the 
scale’s validity were placed in doubt by the re- 
sults of Bitterman and Holtzman [1]. They 
found that a division of subjects by means of 
extensive clinical evaluation demonstrated a 
significant relation between anxiety and condi- 
tioning, whereas a division by means of the 4 
scale alone did not produce significant findings. 
In a more recent study Holtzman, Calvin, and 
Bitterman [7] obtained A-scale and Winne- 
scale scores for a group of subjects. A correla- 
tion of .72 was obtained between the scales, 
which the authors interpreted as evideace for 
the validity of the A scale since the Winne 
scale is an empirically derived scale of neurot- 


paucity 
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icism. Taylor [17] has recently presented some 
indirect evidence of the scale’s validity. She 
obtained the distribution of scores for 103 neu- 
rotic and psychotic subjects, and found that the 
median score was equivalent to the 98.9 per- 
centile for normal subjects. On the assumption 
that the former exhibit greater manifest anxiety 
than normals, she concluded that her findings 
seemed to indicate some relation between 4- 
scale scores and clinical observations of man- 
ifest anxiety. However, in the same article 
Taylor indicated the desirability of direct vali- 
dation using ratings as a criterion. 

The evidence cited as to the validity of the 4 
scale is in several cases contradictory, and there 
is a notable lack of formal validation studies. 
The present study was intended as a formal 
validation study using a criterion of anxiety 
external to the test itself. The particular cri- 
terion chosen was the rating by ward nurses 


of the manifestly anxious behavior of chron- 
ically ill tuberculous patients, 


(2, p. 249], since Tay- 
s definition in selecting 
e. The subtraits were 


slept Poorly, (g) displ 


A trial run of th i 
plished to ascertain its reliability and 
information for its 
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ly selected patients, 10 from each of two ae 
ment wards, were independently rated by A 
nurses on each of the wards. Product monta 
coefficients of the interjudge reliability pee 
-45 and .92. Since the combined ratings x E 
judges were to serve as thé criterion, the ae 
man-Brown formula was applied and a ee: 
values of .62 and .96 obtained. A ż test 0 nif: 
difference between the two r’s was 2.185, es 
icant at the .01 level. In view of this re rat- 
in reliability, an analysis was made of B 
ings for the two wards, and it became BAEN 
that the lowered reliability on the one gree- 
could be chiefly attributed to gross espe 
ment in the rating of one subject. Disc a hal 
with the nurses revealed that one 2f pees 
strong negative feelings toward this apt 
patient, and therefore it was decided sind Jater 
size the need for objectivity in instruct! 
groups of raters. oper 
Subjects. The subjects of the dy ad 
were 93 patients undergoing Ae om- 
for pulmonary tuberculosis; they were n of the 
ly selected from the regident age age 
VA Hospital, Butler, Pennsylvania, THe sn 
range was from 18 to 56 years with : ai 
of 31. The sample inctuded 80 age Oe 
Negroes. The subjects had been ee of 4 
group form of the MMFI as a a were 
routine admission battery, and these i The 
rescored for the items of the 4 ee 
range in obtained 4-scale scores was f JS, 
36, with a median of 13.06, a mean of biegi- 
and a standard deviation of 6.56. Th hes? 
bution was somewhat positively skow (16) 
findings closely parallel those of Jar a rang? 
with a college population ; she obtaine posiciv® 
of from 1 to 36, a median of 14, and 4 
ly skewed distribution. 


cect ition Had pees 
After the 4-scale score distributio! ect 


ere Se 
obtained, the upper and lower 279 ay scale t° 


ed in order to test the ability of e a5 e 
predict manifestly anxious Behanie ae on n 
ured by ratings. Ratings were Co. tre 


tte 
for the 50 subjects falling in the Ke sg 
groups. Extreme groups were sia of th? 
vide a coarse test of the discriminabi ql: u 
scale, corresponding to the use of the | P 
perimentally. The upper and lower g sig 
cent maximized the chance of obtaint, 
nificant difference [9, p. 301]. 


| 
| 


The Validity of Taylor’s Manifest Anxiety Scale 


a of ratings, Each subject was inde- 
where he i. by two nurses on the ward 
obser me and only those nurses who 
Were used as the subjects for at least one month 
Sting ang raters. The time interval between 
months ee ranged from two to six 
eing aes hrs great majority of subjects 
5 coli wit in four months of testing. 
met ohh ae the ratings the experimenter 
vards and oe nurses from each of the 
tion sheets th ained the task to them. Instruc- 
asked to rate ere provided, and each nurse was 
in the Riccar patient not included in the study 
mine if she ce of the experimenter to deter- 
judges were understood the procedure. The 
Mgs with a instructed not to discuss the rat- 
independen s else, and to accomplish them 
© comple s They were allowed one week 
te the ratings. 


Results 
„eeliabiliry of 
a re comput 
Breemen 
rom which 


ratings. Reliability coefficients 
an Dy means of the interjudge 

ethod for each of the wards 
Values tome ee were drawn. The obtained 

es are Pt el with the Spearman-Brown val- 
Using the a nted in Table 1. A chi-square test, 
Was made è transformation method [5, p. 135], 
© test the hypothesis that the ratings 


nterjud __ Table 1 
Be Reliability Coefficients of Ratings 
Ward by Ward 


Ward 
I N r* rot 
F 6 35 39 
R 7 .67 o 20 
> 7 92 96 
5 12 74 85 
gy 83 ot 
11 75 86 


Tod 
Prog aet-mo: 
Bro duct ent correlation coefficients. 


Mome; tai 
ined tinaula to proot ticlents corrected by Spearman- 
A eB! iabi jx 
Were y two judges, imate of reliability of com 


dra 

r btained apa a common population, and 

be tenascin 6.295 with 5 df was 

basis for nt at the .05 level. Thus there was 

l5 “8 r, oe the null hypothesis. The 

> D.. 133 puted by the z’ transformation 
J, was .91, 


alig’ 
ta aty 
Nee of t Te A scale. A t test of the signifi- 
ifference between the mean rat- 


t 
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ings of subjects falling in the upper and 
lower 27 per cent of the d4-scale distribution 
was made. Although the mean difference was 
in the expected direction, the obtained ¢ was 


Table 2 


A Comparison of the Mean Ratings of 
Extreme A-Scale Score Groups 


Group Mean SD SE t 
Upper 27% 64.60 23.01 4.67 
Lower 27% 55.56 21.46 4.49 1.4.07* 
Upper 13% 72.75 21.00 6.33 
Lower 13% 46.17 16.66 5.02 3.2270 


* Not significant at the .05 level of confidence, 
eè Significant at the .01 level of confidence. 


not significant at the .05 level. However, the 
value of 1.407 approached significance, and in 
view of the suggestive nature of this finding 
it was decided to compute a second test of 
significance providing a coarser test of validity. 
For this comparison the upper and lower 13 
per cent of the A-scale distribution were select- 
ed. The obtained ¢ of 3.227 made it possible 
to reject the null hypothesis at better than the 
.01 level of confidence. n 


Discussion 


Reliability of the rating scale. It was felt 
that the reliability of the ratings, as demon- 
strated, was satisfactorily high. The average 
reliability of .91 compares favorably with that 
for the Æ scale itself, for which values of from 
(81 to .96 have been reported [6, 14, Toil: 
Thus an incidental result of this study would 
appear to be the finding that nurses who are 
instructed in the use of graphic rating scales 
are able to rate the behavior of their patients 
reliably. Of course this conclusion must be qual- 
ified when it is recalled that the behavior here 
under investigation was readily observable and 
that the subjects were under observation for 


relatively long periods of time. 


Validity of the A scale. Although the original 
test of validity employing upper and lower 27 
per cent groups yielded negative findings, a 
supplementary test with more extreme groups 
produced positive results. This procedure was 
felt to be justified when the nature of the ¢ 
test is considered. Although the first test did 
not make it possible to reject the null hypothesis 
at the .05 level, it did not establish that no 
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real difference existed between the two groups. 
The supplementary test involved increasing the 
chances of obtaining a large mean difference 
only if there were a relationship between £- 
scale scores and the ratings, and at the same 
time entailed a loss of degrees of freedom. 

The finding of a significant difference only 
with very extreme groups may account for 
some of the differences in results in studies of 
the scale. A review of these studies shows that 
those using the preselection of extreme 4-scale 
groups [13, 14, 16] have usually found a posi- 
tive relationship between A-scale scores and 
simple conditioning, whereas studies not using 
such preselection of subjects [1, 6] have gener- 
ally not demonstrated a significant relationship. 
The results of the Present study are interpreted 
as supporting the validity of the 4 scale only as 
a coarse measure of manifest anxiety, 
experimental use is recommended only 
is desired to select extreme groups. 


and its 
when it 


Summary 


The present research was designed as an 
æ Mvestigation of the validity of the 4 scale asa 


est anxiety. A manifest anx- 


he 4-scale sc 
talized tuberculosi 


erpreted as 


id only as an extre 
measure of manifest anxiety, 
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MMPI Correlates of the Taylor Scale of 
Manifest Anxiety’ 


Glen Brackbill 
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and Kenneth B. Little 


Stanford University 


Rece 
Ported ee number of studies have been re- 
Subjects We , 5, 6, 7, 8, 11, 12] in which the 
Manifest Si selected by the use of a scale of 
e ioma atiety constructed by Taylor [9]. 
innesota M is scale were selected from the 
tory (MMPI ultiphasic Personality Inven- 
anxiety in K as being indicative of manifest 
Teliabilit po e judgments of experts. Retest 
to .g9 ae for the scale range from .85 
Of the Steet aing in part upon the form 
ity = al i the interval between tests- 
ey data in the an have reported some valid- 
yy; rendently ae tm of a correlation with an 
manne [13]. own scale of neuroticism by 
ind with some oe validity figure is about 
i Is used, ight variation if a nonlinear 
Would e 
fictorily ic therefore, that the scale sat- 
rt, complai ig the expression of discom- 
Reneral on eer gai functioning, 
xia sified Se ological malaise which can 
ts the heading of manifest 
bee, © Mani 
ta Used et > 
t ” Groups į 


.Oltema 


3 


i xiety scale (A scale) has 
a P for selecting cri- 
E abei anxiety o pen of the differential ef- 
son ious, how n a variety of functions. It 
cling. form of f ever, that a scale measuring 
Sup an i ii nxiety could be of value to the 
a current tools do not permit 
Dout h interpreting the MMPI, 
relati Te curre i. level of anxiety of the 
ee ship am ntly’made on the basi; of the 
ang 72 Pressi ong certain of the scale scores 
nd K ession (D) å : Sj 
hot Eeg , Psychasthenia (Pt) 
Ore Tesent in th scale provides information 

asil- in e scores of the MMPI scales 

ap) erred from the relationships among 


c] 
ass 
State sme: 
Sub; Nts a 


rom th 
e è 
VA Hospital, Palo Alto, California. 


them, then it would seem a desirable adjunct 
to the standard profile. The present investiga- 
tion was undertaken to provide information 
on this point through the study of the relation- 


ship of the 4 scale to the existing scales of 
the MMPI. 


Procedure 


The product-moment correlation between 
the 4 scale scored from the 50 4 items in the 
MMPI and each of the MMPI scales( with 
the exception of the Lie and the Question 
scales) was computed on the basis of raw 
scores for each of two groups.” The first * 
group consisted of 106 male patients of a Vet- 
erans Administration neuropsychiatric hospital 
(sample 1). They constituted the entire pop- 
ulation of usable records in’ the active files of 
the psychology service of that hospital. The 
modal diagnosis of the group was paranoid 
schizophrenia. The records of 73 male college 
students formed the second or “normal” group 
(sample 2). Scatter diagrams for all correla- 
tions were inspected and judged to be essen- 


tially linear. 
Results and Discussion 


Table 1 gives the correlations between the 
A scale and each of the MMPI scales for the 
indicated are the means and 


two groups. Also i 
standard deviations of the scale score distri- 


butions. 

The most striking feature of the data in 
Table 1 is the extremely high correlation be- 
tween the Taylor anxiety scale and the 
MMPI Pt scale. In the hospital sample the 


2We would like to express our appreciation to R. 
E. Billings and Yvonne Brackbill for assistance in 
collecting data and making the calculations. 
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Correlations of the Tay! 
with the Scales of the 


Glen Brackbill and Kenneth B. Little 


Table 1 


lor Manifest Anxiety Scale 


MMPI for 106 Neuropsychi- 


atric Hospital Patients and 73 College Students 
j Patients Students 
Scale Raw score Raw score 
Tai mean SD Tai mean SD 

A — 19.4 11.7 — 11.8 6.1 
F 63 10.6 as A9 4.2 24 
K —.74 14.1 6.0 —.56 16.0 4.1 
Hs 78 10.5 8.2 -60 4.0 2.8 
D 74 26.0 8.5 38 19.0 4.5 
Hy 50 24.4 Ts -05 20.3 44 
Pa 64 21.4 6.0 16 15.2 4.2 
Mf 45 25.6 5.5 -44 27.1 4.5 
Pa 59 13.6 5.3 15 8.5 2.6 
Pt 92 18.9 11.9 81 10.2 5.3 
Se .83 22.1 14.8 56 9.3 5.2 
Ma .28 18.0 


5.3 -10 16.5 4.5 


reliabilities reported for eit 


In order to deter 
Trelation betw. 


co. 
sult of ch 


Broups were: (sa 


Missions to 


ter; (sample 6) 83 
a Veterans Admini 
pital; (sample 7) 59 


®The authors 


VA Hospital, 


San 


Counseling Center, 
assistance in compiling these data. 


are indebted to Dr. 


n Francisco; Dr. R 
Hospital, Livermore; and 


Stanford Unive 


(.92) exceeds the highest 
her of the two 


sample (.81) 


in the hospital 
re, that’ among 


Jerome Fisher, 
oger Bardsley, 
Dr. John Black, 


rsity, for their 


can be advanced that the excessively high E 
relation is the result of correlated error be ae! 
in the two scales. They are taken simu tae 
ously so momentary variations in mood bedded 
titude affect each equally; both are im ae 
in the same common matrix of the ane, 
of MMPI items inducing a similar polar. 
for the 13 items the scales have in ee ; 
the identical responses are scored tecto 
Such factors will, of course, have between 
increasing the apparent relationship arpos® 
4 and Pt. In terms of the expressed P quite 
of the study, however, the results forme 
clear: with clinical populations no Wi: the 
tion would be provided by the sorne pres- 
4 scale in the MMPI that is not pon îs pos- 
ent in the current battery of scales. d in its 
sible that the 4 scale as admine usefu 
own set of buffer items might provi a sinc 
additional information for the eee 68 
Taylor [10] found a correlation “d with an 
etween the two forms administered se et ah 
18-week time interval. However, hate = t 
[2] report a correlation of .81 P A scale 
Biographical Inventory form of the popula- 
and the MMPI Pt scale in a oe game 
tion when the latter was taken at n clinica 
time as the former. In a more variab “chit the 
Population it is reasonable to assume approx” 
figure would be even higher perhaps t y 
mating those obtained in the present 


. Tables 

An additional finding of interest oe A 
l and 2 is the remarkably low E repo, 
scores of the clinical samples. Taylo schia ric 
a median score of 34 for 103 eton is not 
subjects and, although the mean a1 from 
given, it can be estimated as about 5 p 7891. 
frequency polygon she presents [1 Da ior L 
In another report by Spence and | 
the mean 4 score for 55 neurotics e prese” 
chotics is given as “about 32.” In ‘ any sa 
study the highest average 4 score p the mean 
ple is 21.9 with a standard error Q ure an 
of 1:5. The difference between this aa 4 
those ebtained by Taylor, and Spe teal 

aylor, is obviously quite significan gise? 
ready explanation is apparent for the 


ancy, MP! pro” 
s 
` The comparison of the average v t gota 
files for the high and low scores in ing of tH 
gives some Suggestion as to the mean! 


MMPI Correlates of the Taylor Anxiety Scale 
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E i Table 2 
etw . z 
tween the Taylor Manifest Anxiety Scale and the MMPI Pt Scale in Five Samples 
of Clinical Populations 


Sample 
Population N 
3 General medical pati = ARI Ma SDa Mes SDps 
H k patients 
ete eener paries BO M mo i 
lee A enter clients 60 .93 12.3 77 114 9.6 
7 ae 83 31 146 8.7 E Hs 
———_*Pital patients 59 92 21.9 11.6 ins is 
Scores in diff a ae = E s 3 
esa the mean cg ae Table 3 pre- tive, quite sensitive to environmental press, 
B > 10 subjects of ie = the highest and and willing to admit to being easily disturbed. 
a © college and a-score distributions The low scorers, conversely, utilize both denial 
Ups,* neuropsychiatric hospital and repression fairly frequently and rarely in- 
> e trospect. 
Avera Table 3 Summary 
The relationship between the Taylor Mani- 


ge MMP 
Ten acer cale Scores of the Ten Highest 
ee Cases of the Student and 
ospital Groups 


and 


Group 5 


ies LEE 
llega Hs D Hy Pd Mf Pa Pt Sc Ma A 


0 8 
mee ‘ 21 216 2114 22 8 38 4 4 8 
eh A » 
4 6 % 
12 7 23 21 16 29 8 17 13 15 22 
wa t 
SDital 
High A 3 


17 10 a i 
10 21 36 31 26 28 17 33 38 21 39 


x 


or 

file oo the hi Š 
le is an fi x in the hospital, the pro- 
or oat 7 rents one although the 
in eney for th Suggests that there is some 
tung” Worst bse ia ve to place themselves 
moil are pr ssible light. Overt anxiety and 
this oT and Ar ent as suggested by the high 
activen® Patients + Profile in general suggests 
ely Seeking oo their illness and are 

© mea p. 
n 
Mor Spital ign of the low 4 scorers of 
d. of the ch P, on the other hand, suggests 
or cnied ewe d disorder. The existence 
by A Ut the a y is implied by the elevated K 
Sion, C Peak on Be out of impulses indicated 
Symp 2t migh d reduces much of the ten- 
ig ght ptoduce manifest anxiety 
t 

Erą € colle j 
© profile — group, the higher scorers’ av- 
ha 1A uggests that they are introspec- 
Nteg ODser ‘ 
adar qe aR T-score profiles are not pre- 
able 4 gested reader may plot them on the 
. scoring sheet using the data of 


fest Anxiety Scale, as scored in the MMPI, 
and the other MMPI scales was examined in 
an attempt to discover what additional infor- 
mation would be provided by its use. Two 
samples, a college student group and a neuro- 
psychiatric hospital group, were used. On the 


basis of the extremely high correlation between _ 


the Æ scale and the MMPI Pt scale (.92), 
1 that manifest anxiety coul 
be ascertained from the latter in clinical pop- 
ulations as reliably as from the former. The 
meaning of high and low scores on the Æ scale 
of the two groups was discussed in terms of 
mean MMPI profiles of extreme groups. 


it was concludec 
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Regional Differences in MMPI Responses 
Among Male College Students’ 


Leonard D. Goodstein * 


State University of Iowa 


The 

use 
Ment egy of any psychometric instru- 
` ability of at least in part, upon the appli- 
Cation of a Seale norms. The blind appli- 
ifferent ia = for one population to a 
errors of inte of group often leads to serious 
wit ee The use of the MMPI 
O. Doite Populations has been criticized on 
more deviant i college students tend to be 
than the general population in 


their M MPI 


responses and, second, local or 


regio 
nal no 
r š 
College ör a are thought necessary for each 
Ottle ‘ographical region. Brown [2], 


4 i 

[4], Gilliland and Colgin [7], and 

while a the» development of local 

lare g yler and Michaelis? among 
ctually constructed such local 


Other; 
Norms 
Others 
Norms, 


Black 1 
PN AN Ka taken a somewhat contradic- 
SA at b collected, from the literature, 
les €S, a total N a large group of college fe- 
an €S and univer of 5014, at 15 different col- 
Me Ver-all test sities. Although he did not use 
Prof ata see significance, he concluded, 
fle for colle a that there is a characteristic 
Som, ollege to ee which does not differ 
cane ` the differ cge. It is certainly true that 
canc t that th ences are statistically signifi- 
ce” T1, p. 3 a, are of little practical signifi- 
tegia Š further bs The purpose of the present 
Mui Horns test the notion that local or 
ing a Profiles me. necessary for interpreting 
1e data of college students by examin- 
available on college males. 


ona 
e 


1 
ing 


sed 
Colur t 
2 


pa : 

‘eae presented at the annual meet- 

» Ohio, Ap; terr Psychological Assaciation, 

E aha ae eee > 

Stars r wi 

tatigg, obert A, Te to acknowledge his indebted 
analysis oe the for his assistance with the 

ese data. 


nt p’ Tyl 
alt no Yler a 
wey jee Ts for eae U. Michaelis. University stu“ 
Ucar Mtory, U Minnesota Multiphasic Person- 
on, Nee ee manuscript, School of 
sity of California, Berkeley- 


Procedure 


One group of Ss, consisting of 408 randomly 
selected freshman males, had been tested at the 
State University of Iowa using the booklet 
form of the MMPI. From the published liter- 
ature and from those unpublished studies avail- 
able to the author, seven additional groups 
were selected as meeting the following criteria: 


a, Ss randomly selected or 100 per cent sampling 
technique used. The inclusion of data that had been 
obtained through administration to students in spe- 
cial curricula or to preselected groups of students, 
e.g., student leaders, might lead to a confounding of 
the results and were not included. 

b. N>100. Relatively large samples wer 
ingly more free of bias. 

c. Means and standard deviations reported for all 
nine clinical scales with K correction where approp- 
riate. As the K correction is now routinely used, 
those studies without the K correction were not in- 


cluded. 


e seem- 


Results 
the standard deviations, and the 
the nine clinical scales and 
eight schools are presented 


ement among the scale 
riking. The 


eans on 


The means, 
number of cases On 
the K scale for the 


in Table 1. The agre! 
the eight samples is very st 


fference between any two m 
ale is 7.8 T-score units on the Mf 
he exception of the differences on 
none of the differences exceeds 
which would be less than one- 
core according to the origin- 
al standardization data. The smallness of the 
differences using raw scores is even more strik- 

cale has a difference be- 


ing. Only the Mf s 
o means of over 4 raw score units. 
ge difference in raw score 


means of 
largest di 
a single sc 
scale. With t 
the Mf scale, 
4.9 T-score units, 
half of a standard s 


tween any tw 
The median ran 
units is only 1-7 

The data from these eight colleges were 
then placed into three groups based upon geo- 
graphical regions: the Eastern group, including 
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Table 1 z 
iati in T Scores for , 
PI Means and Standard Deviations in S 1 
PS Arranged According to Geographical Region A 
* f i 
Mf Pa Pi 
K Hs* D Hy Pd* 
College N ot 
X 56.0 55.0 i 
ae 316 M + 530 53.0 55.0 55.0 ae om oe 12.2 ri 
aine z 10.8 i A aL 
SD + 8&5 121 77 1 2 ke 5 j 
ae 121 M + 534 53.5 56,3 57.0 59.6 oe B9 R 
i peas SD + 83 118 77 95 86 9. Pe 
3 : on 
57.0 
Midwest x 58.0 54.0 56.0 11.0 
3.0 56.0 57.0 5 11.6 
p: S o E e TE a2 98 108 7.9 128 58.1 
Minnesota 1321 M 
5 56.0 a 
[11] SD y 59.0 53.0 56.7 10. 
isconsi 5 2.2 55.0 56.0 10.1 
i i ` 56.9 ; 
West 5 4.1 56.9 9.6 
Montana State} 456 M 142 50.5 525 54.5 56.0 58.0 po lor 89 
SD 45 100 121 73 9.6 es 534 56.8 ne FA 
New Mexico 149 M 164 54.1 539 578 Fa 99 78 10.2 ws 55.8 
[9] SD 94 87 105 78 10. 9 sao 53.6 SA 92 
Utah State 842 M 13.8 51.5 50.2 52.9 54.3 54, + 
[5] SD 44 71 


Median 


t K added- but its 
From an unpub 


5035 M 


value not reported. 


lished paper by Donald P, Hoyt, 
The presènt author wishes L. E. 


Wisconsin and Montana State data, 


ing the niversitie 


isconsin; and 


ontana State College, Utah Stat 
the niversity of New Mexico 


14.5 52.3 528 550 563 585 53.0 


6.7 . 
8.3 ios 1038 
BD 46 (88 ita “Fg "os ins ee 


Drake and 


Table 2 
Analysis of Variance of Means 
Source df MS F 
Between Ss 7 11.37 
Regions 2 1.69 
Error (b) 5 15.25 
Within Ss 64 67.55 
Scales 8 46.71 56.72%» 
Regions X Scales 16 1.45 1.63 
Error (w) 40 -89 
Total 71 
peti 


56.9 | 
á z 7 52.6 56.8 10.3 
14.4 51.1 na E p yes 8.6 10.4 108 538.0 
4.6 81 10. e . ‘ 

y innesota. 
Student Counseling Bureau, University of Minn 


10.7 
90 79 8.8 91 90 ai 58.7 


> 


* blish the 
Dr. G. A. Renzaglia for permission to pu 


í E nificant, 
the obtained F for the scales w clini e 
indicating that the means on cone 's i 
scales were not equal. The o Arao j 
regions and the regions X scales a to 5 os 
not exceed unity. There is no ev: l differens? 7 
port the notion that geographica pt meat 

are significant determinants of 


Table 3 n. p 
i S. 
Analysis of Variance of Fi 
MS 
Source df - 
: 2.3 
Between Ss 7 an 
Regions 2 a t 
Error (b) 5 E i 
Within Ss 64 a r 
Scales 8 ʻi 
Regions X Scales 16 a 
Error Lw) 40 me > 
Total 71 
ee N E l 
**p <.01 r Ki 


h 
vaP on 
To test the importance of her ae on 
-egional influences, a similar ana tion CF 0 
Performed with the standard ao ed ” 
he variability data were also 


| 


| 
| 


e 


p coe in the same manner as the mean 
“ee he identical analysis of variance de- 
as used.* 

Eoo be seen in Table 3, only the ob- 
which Seige was statistically significant, 
e ne elie indicatè that the variability of 
* and Py ny scales was not equal. The D 
the Hy om have the largest variances while 
a me and Pa scales have the smallest 
ie ` : he F's for regions and the regions 

. et oerion were less than unity. On 
“conclude ae s analysis, therefore, we may 
Y depend at the variances are not significant- 

ent upon regional influences. 


Rs inepegi Discussion l 
Schools sia of the means for the eight 
sistently hi a that no one group was con- 

A iar, or lower than any other group. 
More a owe of scores would seem to be 
to the ali of chance fluctuation than due 
Mental facia “8 any cultural or environ- 
regions wald. he obtained differences over 

d seem to be of such little conse- 


uence th 

ê th 

Seem. at the developrnent of regional norms 
S unnecessary. 


It is ; 
S 1 
Scores age to note that the mean T 


Xpected bes nine clinicel scales are above the 
Support of me value of 50. This finding is in 
2 group, a the notion that college students, as 
the Man 7 more deviant in their responses to 
Used in fis than the general adult population 
ese a seins of the instrument. 
Preted to. s; however, should not be inter- 
ul in Sete that the MMPI cannot be use- 
Its, but re the adjustment of college stu- 
ms for col er supports the idea that separate 
only desir bl lege students as a group are not 
n thi able but essential. 

Jang 70 regard it is interesting to note that, 
©% of an the cutting score, approximately 
abnormal” coral group of 5000, or 750, have 
this criterio scores on the Ma scale. Extending 
Proximatel, to the other scales, we identify 
Borma] o ely 7 to 10% of our group as ab- 
Scales, Wee of the Pd, Mf, Pt, and Sc 
o Whi ithout allowing for any overlap, that 
mp. © Such data do not usually fulfill the as- 


lons 

pns abo eae = 

Cate tance as normality necessary for an analysis 
thos .).Tecent empirical evidence would indi- 


sli a i 
ght deviations from normality are of 


© cong, 
Se 
* quence and may be ignored [8, PP- 78- 
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is, a single S scoring above 70 on more than 
one scale, we would have identified approxi- 
mately half of our 5000 male college students 
as, abnormal by such a procedure. While 
this, of course, may be a valid “diagnosis,” the 
capacity of our college mental hygiene facilities 
certainly demands a more rigorous screening 
instrument. Seemingly the usefulness of the 
MMPI as a screening test in the collegiate 
setting would depend upon the development of 
new cutting scores. 

The consistency in the pattern of scores 
among the eight schools also seems worthy of 
note. The peaks on Ma, Mf, Se, Pt, Pd, and 
Hy suggest that there is a characteristic pro- 
file for college males. They appear to be more 
feminine in their interests, to be more active, 
less inhibited, but more worrying than the male 
population in general. This diagnostic picture 
would seem to be validated by clinical obser- 
vations in the classroom and on the campus as 
well as in the counseling office. 

We may then compare our typical profile for 
college males with that obtained by Black [1] 
for college females. This comparison is shown 
in Figure 1. In each case the points are based 
upon the median mean, in our study the median 
is of 8 colleges, in Black’s study it is of 15 
colleges. The total N’s, however, are very simi- 
lar, 5035 for our sample, 5014 for Black’s. 

The differences between these two profiles 
are rather interesting. The males are higher 
on all the clinical scales with the exception of 
Pa where the points almost coincide. The 
largest differences are on the Mf, Ma, Pt, D, 
and Hs scales. The women are below the ex- 
pected mean value of 50 on the Hs and D 
scales while the men, as noted before, are con- 
sistently above 50. The women are higher on 
the K scale, indicating a somewhat more de- 
fensive attitude. The effect of this higher K 
value, however, is to reduce the differences be- 
tween the sexes on corrected scales as the 
higher K results in higher values on five of the 
nine scales. a 

While it may not be obvious upon first 
glance, there is a good bit of similarity between 
these two profiles. If we exclude the Mf and 
Pa scales from consideration, the profiles then 
appear quite similar with peaks on Ma and Se 
and valleys on Hs and D, although the fe- 


58 
o 
S 
F 56 
i 
254 o- 
= g 
ras 
$52 

50 


Hy 
MMPI SCA LES 


male profile is, of course, lower, It js rather 
Surprising to note that, while college males 
are considerably more feminine in their in- 
terests than males in general, college females 
are not more masculine in their interests than 


Summary 
The present Study has be 
the results of MMPI ad 


deviations also showed 
differences. The obtai 
seem tc be of such litt 


MMPI profiles of male an 
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= MALES 
(N>5000) F 


7 
\- FEMALES -=g 


+ 
Ma 
Pa* mf Pa Pt A 
(ČŽincludes K Correction) 
d female college students. ii fot 
j acteristic PTO” age 
While there = o little from © the 
the college male that Ji 


rom le 

ifferent al 

to college, it is ac Pal ege Tol- 
isti e 

characteristic profile of t vofile of t na 
and from the characteristic p 


r ; 
appea "ELA 
lege female. New norms moule atag tes 
sary in using the MMPI asa opulations: 
clinical work with university P' 
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Social Desirability as a Factor in Edwards’ 
Personality Preference Schedule Performance 


Leslie Navran and James C. Stauffacher 


VA Hospital, American Lake, 


The Edwards Personality Preference Sched- 
ule (EPPS) is a new personality inventory 
which yields scores for 15 of the needs in Mur- 
ray’s theoretical system. These are: achieve- 
ment, deference, conjunctivity, exhibition, au- 
tonomy, affiliation, intraception, succorance, 

ominance, abasement, nurturance, 
durance, heterosexualit 


: Thus, the structure of 
such that for 


' This Paper presents data from 
signed to evaluate the usefulness of the EPPS 
for counseling and guidance in the field of 
nursing, 

The EPPS Was administered 
affiliate nurses spending thre 
dence at VA H 


a project de- 


to 25 student 
n e months in resi- 
ospital, American Lake, Wash- 


Washington 
eristiCc 

they ranged from most to least ee needs’ 
of themselves. Then, they ranked ieee 
again from most to least sety the 15 nee 7 

Composite ranks were made o the studen! 
from the EPPS raw scores, from t their judg 
self-descriptions, and finally from composi 
ments of social desirability. The ComPay 
EPPS raw-score ranking correlate 01 wit 
the self-description composite, si wevet, 
the social desirability composite. 3 90 wit 
self-description rankings correlate nalysis W3 
social desirability judgments! S each indr 
made of the same coi relations ior lations Be 
vidual. While none of the 25 cor it judg; 
tween EPPS scores and social sae zero, 
ments was significantly different if-description® 
of the correlations between se ificantly dif- 
and social desirability were signi ee 44 of 
ferent from zero at the .05 level em wen 
more). At the .01 level, 13 eo “(one-taile 
above the required value of .5 i 
test)? i ort to t 

These results lend impressive EF n elin” 
Proposition that the EPPS not only 4 


eS tt 

; irability 2*4". 
ated the influence of social dein” reduced F 
item level, but has also considerably hermot® 


e 
Operation at the variable level. reser? 
it is felt that the criterion of se! fluenced by 
has been shown to be so heavily in to be use 
Social desirability considerations so ed to at 
less. More objective criteria are n 
tack fruitfully the issue of validity- 


with © 
i icated jden 
*This study has since been replica }most id 


è th a 
Second ,roup of 27 affiliate nurses, W! 
tical results, 
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n° Relation Between Acceptance of Self and 
eptance of Others Shown by Three Personality 
. Inventories’ 
Katharine T. Omwake 


Agnes Scott College 


In y 

` Psychologists seg psychiatrists and clinical 
JC attitude t nave observed a relation between 
tient and hi ard the self shown by the pa- 
er x his attitude toward other people. Ad- 
who Ee a a depreciation of others in those 
Serted = felt inferior. Horney [5] as- 
Self jg inca a person who does not love him- 
Said that i le of loving others. Rogers [8] 
or that ve 7 Person who accepts himself will 
ry reason have better interpersonal 


goef “he AN, as a person begins to accept 
'S attitude t comes capable of experiencing 
nce of the wie others. Changes in accept- 
Acceptance oe and correlated changes in the 
“Ntered the others occurring during client- 
Er stud rapy were studied by Sheerer [9]. 
i based 2? Pd a similar one by Stock [10] al- 
Showeq t a small number of counseling cases, 
ard others Perceptions of others, feelings to- 
cantly Bt acceptance of others are sig- 
ngs about T the perception of the self, 
they ese stu lettin and acceptance of the 
ther, PY, with a i show that, in the course of 
atti is a cory e increase in self-acceptance 
tud eal aE increase in favorable 
Evera] others. 
= Rigen have been made to see to 
s tri ese observations made by clini- 
sles a more normal popu- 
on teades Ta constructed a question- 
€ administ oward the Self and Others 
n a uniy ered to several groups of stu- 
toy, tedents bea class composed chiefly of 
74.4 the self e correlation betweeri attitudes 
it litle with and those toward others was 
y vas 54. B a younger group of.college age 
ue erger [2] used the definitions of 
ped = article is an abbsevi n ji 
reviated version of a paper 


il he E 
Sophy aid E of the Southern Society for 
sychology in Atlanta, April 1954. 


acceptance of self and acceptance of others 
which Sheerer [9] had made as the basis for 
the development of a questionnaire or scale. He 
found a correlation of .65 between acceptance 
d acceptance of others for evening 
students. This is 


by Phillips [6], 


of self an 
students and of .36 for day 
in agreement with the study 
who also found a closer relation between ac- 
ceptance of self and acceptance of others in the 
older group of college students than in the 
younger group. Bills, Vance, and McLean [4] 
devised an Index for Adjustment and Values 
which measures self-acceptance, and a corres- 
ponding form which shows the individual’s 
perception of how other people accept them- 
selves. 

Phillips [6], Berger [2], an 
and McLean [4] have published studies of the 
reliability and validity of their tests, and the 
results obtained from administration of them 
to college students and to some other groups, 
but they have not published the tests them- 
selves. In the present study all three of these 
unpublished tests, by permission of their au- 
thors, have been administered to a group of 


over one hundred college students. 


Problem 
ed to test the assumption 


that, in a normal population, there is a positive 
relation between the acceptance of self and the 
acceptance of others, that those who are self- 
acceptant are also acceptant of others, and that 
those who reject themselves also tend to reject 
others. 

A second hypothesis is that there should be 
agreement among tests designed to measure 
the same trait; that, therefore, various tests of 
acceptance of self should give similar results, 
and that various measures of acceptance of 


others, likewise, should agree. 


d Bills, Vance, 


This study is design 
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Method 


Three unpublished personality inventories, 
made available to the investigator by sie 
thors, were used in this study. They are: t 
scale for Self-Acceptance and Acceptance o 
Others by Berger [2], the questionnaire on At- 
titudes Toward the Self and Others by Phillips 
[6], and the Index of Adjustment and Values 
for self and for others, by Bills, Vance, and 
McLean [4]. Each was mimeographed with- 
out a title, so there was nothing to indicate 
what the inventory was designed to measure. 
These three personality inventories, described 
below, were administered to 113 students in 
the first course in psychology at Agnes Scott 
College. The students were told that the in- 
vestigator wished to make a study of the per- 
sonality tests, and that in order to make the 
study it was not necessary to know the identity 


aS as- 


Acceptance and 
: sists of 36 items 

concerned with accept and 28 with the 
andom order. The 
ts showing atti- 
at Pm not living 

very effectively but I just don’t believe I’ve got it in 
ays.” “I believe 
accomplish- 
across work that de- 
toward others. The 


Person taking t each item on a five- 


point Scale. 


The Attitudes 
tionnaire by Phill 


toward 
taking 


the test is to rate attitud atement on a 


five-point scale, 


The Index of Adjustment and 
Vance, and McLean Consists of 49 4 


acceptable, busy, calm, poised, and 
ject is astted to use each word to 


of self-acceptance used in this study 
others is similar. The subject uses th 


€ same 49 ad- 
‘ectives in turn to complete the sta 


tement “Other 
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sith friends particu 
E annn persons,” wit sale fee 
eas cel and indicates how di Pa 
about themselves as they are, us = pane exit 
le as before. This gives a measu canis 
mapa’ others are seen as accepting 


Results and Discussion 


. -accept- 

The three inventories nt ela- 
ance agree markedly, as shown y it there 
tions in Table 1. As might be ne baste whi 
is closest agreement between t sair Degree 
are most similar in form and ap aa 
of acceptance of self given by e gelf-accel 
correlates .73 with degree j whic 
ance in Phillips scale. m mt techs 
measures self-acceptance by a “G ie other 
nique, is in less close agreemen i correlation 
two scales, although even iai- Se ith j 
of .49 with Berger’s scale an has pondence. ; 
lips’ indicates a substantial corr ca 1 PP 
three correlations are significan 
cent level of confidence. 


Table 1 


of S 
eptance 
Correlations of Measur-s of Accep 


elf 


Others 
and Acceptance of m of 


s nifi- 
Correlation “ance 
Tests ; 
ee ee wee 
Acceptance of self vs. 1% 
acceptance of self 73 5% 
Berger vs. Phillips 49 5 
Bills vs. Berger 55 
Phillips vs. Bills . 
Acceptance of others vs. : 19% 
acceptance of others 60 59 
Berger vs, Phillips "23 A 
Bills ys. Berger 13 
Phillips vs. Bills 
Acceptance of self vs. 196 
acceptance of others 37 90 
Berger ys. Berger i 39 19 
Bills vs. Bills 41 59 
Phillips vs. Phillips 25 69 
Berger vs, Phillips 33 59 
Ferger ys, Bills 33 = 
Bills ys. Berger 18 19 
Bills vs, Phillips 30 196 
Phillins ys, Bills om 
Phillips vs, Berger : 2 he 
amo al- 
There is slightly less ae al oe 
tests showing attitudes toward i -in c0 t pe 
9o the two tests which are simila 


t10 
, orrela i 
ton agree most closely. da Phillis Í 
tween the tests by Berger an 


| 
| 


Acceptance of Self and Acceptance of Others 


significa 
Ower naia br the 1 per cent level, but 
tests of accepta correlation of .73 between the 
ince Bills’s Į ie of self by the same authors. 
Vidual’s mais Oe for others shows the indi- 
themselyes ception of how other people accept 
Is acceptant = am than the degree to which he 
It correlates | hio: hers, it is understandable that 
Individual’ ess well with tests measuring the 
ex i tg toward others. Bills’s In- 
an ae with Berger’s scale, signifi- 
elation of 13 Mie ra while the cor- 
ally significant. lillips’ scale 1s not sta- 


a There is 
Accept P a tendency for those who 
: View thae es to be acceptant of others and 
€ other hand as being self-acceptant, and, on 
and, for those who have a low opin- 


Or tl 

len 

S ISe x 

ee others lves to reject others also, and to 


per 
= A es level, between the accept- 
asured b attitudes toward others as 


a = Dy the i ; 
nd Phillips. le inventories by Berger, Bills, 


Sige Ta are similar to those ob- 
he same a aga pace [6] i 
erger’s Smell ge as the group in this 
in the pres ation is .37 as compared 

5 ee ent study; Phillips’ corre- 

Drese he Correlation a closer relationship than 
latig group. Bil] ha 41 obtained with the 
bar; between s 7 las not reported the corre- 
self-other attitudes, so no com 


S of t 


ation of 


As m: 
Ce Might i 
Boa = wai it each test of self-ac- 
by t ng test of i closely with the corres- 
for © same ay oe toward others made 
others thes foes than it does with the scale 
e omak another author. In every in- 
tent ] the same rae: between the self-other 
“vel of a is significant at the 1 per 
“*CCeptance lence, whereas Phillips test 
ce tions of A eal sign 
tests i, egree of statistical signifi- 
er investi attitudes toward others made 
ations a: come Three of the four other 
S* and sae self-attitudes measured by 
‘nother t itudes toward others obtained 
evel, A est are significant at the 5 per 
s shown by the correlations in 


% 
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Table 1, there is a consistent tendency for self- 
attitudes to be reflected in attitudes toward 


others. 


A comparison was made of the attitude 
toward others held by those who represented 
the extremes of self-acceptance and of self-re- 
jection. The self-acceptant group consisted of 
19 subjects who were in the upper three deciles 
on all three tests of self-acceptance; the group 
who rejected themselves was composed of 12 
individuals who were consistently in the lowest 
three deciles on all three tests. The larger num- 
ber in the self-accepting group shows that a 
high degree of self-acceptance is more consist- 
ently shown than is a low degree; only a small 
number are extremely se 


lf-rejectant on all 
three tests, while a larger number consistently 
hold themselves in 


high esteem. On each test 
the mean score on attitude tow 


ard others made 
by the self-acceptant group is higher than the 
mean score made by the self-rejecting group. 
The difference between the means Is signifi- 
cantly different from zero well beyond the 1 
per cent leyel of confidence. This difference 
between the means on the tests by Berger and 
by Phillips indicates that those who are most 
self-acceptant also have a high degree of ac- 
ceptance of others, while those who reject 
themselves also hold others in low esteem. The 
difference between the means on Bills’s Index 
would indicate that those who are self-accept- 
ant perceive others as accepting themselves, 
while those who are least self-acceptant per- 
ceive others as rejecting themselves. As had 
been assumed, there is a direct relation be- 
tween the attitude an individual holds toward 
himself and tha 


t held toward others. 


The data presented here, although based on 
‘es that do not probe very 


personality inventor! 

deeply into personality dynamics, verify in a 
fairly large grouP of college students the con- 
clusions derived by clinicians from therapy 
sessions. There is evidence that in the normal 
population, as well as in those undergoing ther- 
apy, attitudes toward the self appear to be re- 
flected in attitudes toward other people: the 
lower the opinion of the self, the lower the 
others. Only when the self is re- 
egree of acceptance 
tively to others, t^ 


opinion of ! 
garded with a fairly high d 


iş it possible to relate effec 
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understand them, and to regard them as per- 
sons of worth. 


Summary 


To test the hypothesis that in a normal pop- 
ulation there is a Positive relation between ac- 
ceptance of self and acceptance of others, three 
unpublished tests measuring attitudes toward 
the self and toward others were administered 
to 113 college students who took them anony- 
mously. The tests are: the scale for Self-Ac- 
ceptance and Acceptance of Others by Berger, 
the questionnaire on Attitudes Toward the Self 
and Others by Phillips, and the Index of Ad- 


justment and Values by Bills, Vance, and 
McLean. The thre 


a Correspondingly 
and perceive others as 
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SelfAcceptance and Its Relation to Conflict 


Herbert Zimmer 


Air Force Personnel and Training Research Center 


Raim 

evaluations ol was able to show a shift in self- 
Which diq in successfully counseled clients, 
Seled client not occur in unsuccessfully coun- 
aPproval t s. The shift was one from self-dis- 
Bills, Van self-approval. Following his lead 
metr Fanaa McLean [2] defined personal 
€ concept of as any discrepancy between 
self” T a ia self and the concept of the ideal 
Uses the total ndex of Adjustment and Values 
self-concept. of the discrepancies between the 
a a Nr hi the concept of the ideal self 
demonstrate ry of adjustment. Roberts [5] 
mes on a w significantly longer reaction 
S€lf-conce vord association test for words with 
À Ords wae discrepancies than for 
Sich me sere pagiies and considered 
Loye ills Ti]. a “vaiid index of emotion- 
eh Re a repeating Roberts’ ex- 
the direction, eee method, found a 

the € Present study of Roberts’ results. 
angie cacy of a y was undertaken to check 
Sos aa ae eati a 
that ot maladjust à of-conflict, and by infer- 
ae Presence ment. It tested the hypothesis 
ices associated aN ape ules personality 
this Paney on th a a self-concept-ideal-self 
oothesis w at trait, A confirmation of 
of an nie es Roberts’ findings 
self 'StTUments - direct rationale for the use 
and opctePancies mploying_ self-concept-ideat 
shoul improvement a measure of adjustment, 
tied © noted th gia situations: It 
i Prior to = this experimert was car” 
abs Bills’ [1] e publication of Roberts 
and p cheq the a articles, and has therefore 
means of ame problem independently 
a different method, 


Periment 
in 


Fifty. Proced 

th, ty-tw, : cedure 

S e, suet subjects rated themselves (4) aS 
(b) as they would like to be with 


respect to 25 personality traits on two similar 
seven-point rating scales. By using the trait 
adjectives as stimulus words in a word associ» 
ation and reproduction test, six of the tradi- 
tional complex indicators were obtained, and 
employed as an index of conflict. 

The subjects were 26 male undergraduate 
students at the University of Rochester and 26 
male neuropsychiatric patients at the Canan- 
daigua, New York, Veterans Administration 
Hospital. A specially constructed 20-item vo- 
cabulary test was used to screen all subjects 
with an inadequate understanding of words of 
the level of difficulty used in the experiment. 

The 25 trait adjectives selected for use in 
the experiment were: leisurely, emotional, am- 
bitious, deliberate, trusting, sentimental, cau- 
tious, refined, energetic, orderly, poetic, wary, 
lusty, dominant, spontaneous, economical, re- 
spectful, daring, precise, meek, persistent, ar- 
dent, conventional, determined, and obedient. 
They were chosen on the basis of (a) occur- 
ring 6 to 10 times in one million words in the 
Thorndike-Lorge word count [7] column G, 
(b) not representing a cultural stereotype of a 
desirable or undesirable personality trait, and 
(c) having personal and dynamic meaning. 
Word frequency was controlled because of its 
possible effect on word association reaction time. 
Stereotyped traits were eliminated, since con- 
sistently extreme ratings might affect the size 
of gelf-concept-ideal-self discrepancies. The 
order of presentation of stimuli was varied 
systematically to counteract position effects. 


Each trait was evaluated by the subject on 
two seven-point rating scales. The self-concept 
scale ran from “7 Tama very... person” 


to “1. I am definitely not a. -- person.” The 


ideal-self scale ran from “7. I would like to be 
a very -+ person.” to “1. I definitely don’t 
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want to bea... person.” The complete list 
of traits was first rated on one scale, and later 
on the other scale. 

The complex indicators in the word associa- 
tion test, which were used as the index of con- 
flict, were (a) long reaction time, (b) long 
reproduction time, (c) defective reproduction, 
(d) repetition of the stimulus word, (e) re- 
sponding with more than one word, and (f) 
obvious and clear-cut manifestations of overt 
emotional behavior. Reaction time was re- 
corded with a Standard Electric Timer. Three 
of the indicators are identical to the complex 
indicators in Hull and Lugoff’s [3] list which 
show the highest positive correlation with the 
combination of all the complex indicators used 
by them. Each of the six indicat 


since no empirical system of 


distinctly 
while traits 
ator did not. For this 


Table 1 


with one complex 


Subjects 
Hospital College 
Statisti i 
atistic group group Difference 
(V=26) (N= 26) 
z Traits with 0 indicators 
ean 6.23 8.27 
a 2.19 1.93 = 
3 3.505 
- -001 
Traits with 1 indicator 
Mean 5.69 
Ai 6.23 
SD 2.18 2.66 i 
t 
-785 
p >.20 
Traits with 2 indicators 
Mean 13.08 10.50 2.58 
SD 2.15 2.21 
P 4.188 
Ż <.001 


Herbert Zimmer 


c e 
reason a nonconflictual trait was defined we 
which did not elicit any complex indiana 
and a conflictual trait as one which € 
two or more complex indicators. a 

The data given in Table 1 can pint cone 
sidered suggestive, since the two ar 
pared in it were not matched. It Oe a a 
give some indication of the relative ae fae 
traits with varying numbers of comp | 
cators as indices of conflict. 


con 


Results sae 
. ces in the 
Table 2 shows that no SS ier 
of self-concept — ideal-self eager co: 
found between conflictual and nor 


traits. 


Table 2 a 
ies o 
al-S Discrepancies i | 
Self-Concept-Ideal-Self sg Be l 
Conflictual and Nonconflictual me 
E ———— 
Traits 
d . anc? 
p ta piffere™ 
Statistic Nonconflict Gonnie: ae 
All subjects (N = 52) 4 
Mean 1.20 se ‘37 
SD. 91 8 “431 
i 4 >.05 
d | 
Hospital group (NV = 26) i" | 
Mean 1.30 _ a, 
SD 82 ; 


College group (N=26) 


„01 
Mean 1.11 1x a 
39 .48 „09 
SD ` >05 
t 
Ż a3 
dat® | 
these 4s 
A sign test was also done on e case W 


With the number of cases at 51 ie fr egue 
a tie), and the number of the pah ou 
sign at 21, no significant differen jctua if 
between conflictual and noncon ? sige 
with espect to discrepancy scores: two 
cant difference exists between the wee! 
with respect to the diferent itl 
Scores on conflictual and nonconfl hyp? 
The results do not support the erson? 
that the presence of conflict over 4 p“ tv 
trait is associated with a discrepan® 


. 


Self-Acceptance and Its Relation to Conflict 


Aga of self and the concept of the ideal 
ee ee these results are not in 
and Bills E the findings of Roberts [5] 
eect d However, they are in line with 
self-conce ‘d by Smith [6], who reports that 
iscernible eff Fan discrepancies have 0 
and rereah eee on ease of perceiving, learning, 

nbering of trait adjectives. Perhaps 


uture studies wi 
i ies will be able m 
ifferences, to resolve existing 


Summary 
| This stud 


sis that the y was designed to test the hypothe- 


ality trait — of conflict over a person- 
tween the co associated with a discrepancy be- 
ideal self Topi of self and the concept of the 
Would Rd Shere nara of this hypothesis 
oying self-co a rationale for instruments em- 
ncept—ideal-self discrepancies as 


s (a) as they are, and (4) as 
ae fe to be with respect to 25 per- 
Bros two similar seven-point rating 
Words in a ing the trait adjectives as stimulus 
test, six of = association and reproduction 
Te 9 tined traditional complex indicators 

ed, and employed as an index of 
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conflict. The results do not substantiate the 
hypothesis, and thereby fail to support the con- 
tention that discrepancies between the concept 
of self and the concept of the ideal self are di- 
rectly indicative of conflict. 
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A Note on Consistency of Rigidity as a 
Personality Variable 


Hermann O. Schmidt, Charles P. Fonda, 
and Elizabeth L. Wesley? 


Norwich State Hospital 


Luchins [1] has asserted that problem-soly- 
ing rigidity is “not a function of the personality 
Per se, but of particular field conditions,” On 
the other hand, findings reported b 
gest that consistent differences in 


One test, the Wesley Rigidit 
via self-report a variety of 
by Psychologists 


ubjects were classified into three categories 
of rigidity according to the de; 
lung effect: I. Mini 


tions by a short method. II 


ay be obtained 
Schmidt, Nor- 


ocument No, 
Project, Pho- 


ma » Library of Con- 
2Now at the University of Louisville, Medical 
School, 


i etnod, 
spontaneous shift to the short m 


% emonstr 
sistent use of this method after Siete w 
Included in this group also eet proble 
either failed to solve one of the ical fashion 
or solved any of them in an atyp shift to t 
II. Maximal — No apni i Jonge! 

i sion 1 

short method, with rever astrado o 
method at least once after dem 


shorter technique. 22 sub 


; 

On the Wesley scale, the re 489), 
jects in Group I was 19.9 III the me, 
whereas for 23 subjects in Group difference ) 
was 23.35 (SD = 4.43), This -tailed g 
significant at the .01 level —_ means fa 
with ¢ = 2.42. Differences — erwe, a 
Groups I and II (z= 1,0) insignificr 
Groups II and III (¢ = 1.7) ar ue rigid, 
Thus the hypothesis is supporte: sonality 
as here defined, is a consistent per 


ation: 


Brief Keport 
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A Therapeutic Approach to Reading Difficulties 


Julius Seeman 
George Peabody College for Teachers 


and Benner Edwards 
Chicago Public Schools 


oe 


e Pnl is so central in our culture that 
‘the een, ra gone into studies of reading in 
siders the rel ne aspect of this literature con- 
© personalit ationship of reading performance 
one must c age From this literature 
causes of = ude that, among the multiple 
ance Should tee difficulty, emotional disturb- 
In some case 5 aa a relevant factor 
\ View are s. Many studies which affirm this 
A to be found [3, 4,5,6,7, 9, 11]. 

ahe cme hypothesis that there isa 
isturbance ne ree between personality 
3S a corolla > y aaing difficulty, it follows 
Signed to Ete at experiences which are de- 
erapeutic odify feelings and attitudes in a 
*rformanc i should also modify reading 
Play thera e. Bills [1] has shown that when 
Teaders PY Sessions were held with retarded 
uring an reading gains accrued than 
Companion omparable no-therapy period. In a 
Tetarded te ad conducted with well-adjusted 
OY made no dif [2], he found that play ther- 
| ren, Can con ‘| erence in reading performance. 
ĉading gai £ ude that therapy is relevant to 
May be at in primarily where emotional factors 
Performa Issue, but that therapy will nct help 
Out, . ance when emotional factors are ruled 


Th 
e st 
consid Udy to be reported here takes these 


erati : c 
Y, we eh as a point of departure. Specifi- 
Peutic ap Sh to test the hypothesis that a ther- 

Proach to teaching will yield sigri- 


fica 
n 
Chan - fs i 
Performans in personality and in reading 


J 

Opin: Procedure > 
fore hier 
lowi Ag hypothesi i 

Wi; esis we must include the fol- 


(gq) . © Pro : i A 
- : e aS in the experimental design: 
JUstmey- > s ildren who rank low in personal 
and in reading achievement, (4) 


of design. In order to test the 


provide an experience which is therapeutic in 
intent, (c) measure the effects of this experi- 
ence upon personal adjustment and reading 
performance, and (d) provide adequate con- 
trols so as to rule out alternative explanations 
of the experimental outcome. These points will 
be considered in greater detail below. 

Selection of experimental and control groups. 
The samples used in the study were drawn 
from the fifth- and sixth-grade classes of a 
large city. The children were predominantly 
of lower socioeconomic status. 

For the identification of children who ranked 
low in personal adjustment we used the Tud- 
denham form of the Reputation Test [10]. 
This is a peer-rating questionnaire which seeks 
judgments of specific behavior traits that can 
be assigned to positive-negative adjustment 
categories. 

For the selection of children low in reading 
achievement the Gates Reading Survey was 
used. The selection criterion here was a read- 
ing score significantly lower than average ex- 
pectation for the grade. This criterion is dif- 
ferent from the usual criterion of “reading 
retardation,” which is usually defined as read- 
ing performance significantly below expecta- 
tion for a given mental age level. The use of 
our criterion was predicated on the assumption 
that where a child was low in both reading 
and adjustment rank, intellectual functioning 
might be below potential. This assumption, of 
course, is implicit in the entire hypothesis of 
the study. We thus postulate that a thera- 
peutic experience would have a releasing effect 
upon intellectual functioning, which would be 
reflected operationally by a gain in reading 
scores. 

Experimental and control groups were se- 
lected in two stages: first, the 38 children with 
the lowest composite rank in both the Tud- 
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denham and the Gates were selected for the 
study; second, children were paired with ref- 
erence to score similarity and assigned one 
each to the experimental and control group. In 
this way, comparability of experimental and 
control groups was insured. The first row of 
Table 1 indicates the close similarity of initial 
scores. 


The pattern of testing. After the groups 
were selected, the Rogers Personality Test [8] 
was administered to the children in groups of 
four to six according to the test’s directions. 
This test was chosen to yield another measure 
of personal adjustment. 


At the end of the experiment, the Rogers 
and the Gates tests were given again to the 
experimental and control groups, and the Rep- 
utation Test was repeated with 
from which the experimental 
groups were selected. 


h the classes 
and control 


The experimental treatment. For the dura- 
tion of the experiment the teacher-therapist 
met with the children for one-half hour daily 
in groups of four to seven. Varied materials 
were provided, including art materials, books, 
and games. The teacher made it clear to the 
children both at the outset and during the ex- 
Periment that they could use the time as they 
wished: in talking, reading, working puzzles 
and games, drawing, or just sitting. The teach- 
er’s intent throughout the sessions was to main- 
tain an open, permissive, understanding atmos- 


phere which could encourage exploration and 
expression by the children. 


The children r 


I esponded by using the time in 
varied ways. Th 


ere was frequent interaction 
and teacher. Approximately 


Results 


The ‘quantitative findings appear in Table 1, 
From the table several results 
First, it is clear that th i 


Julius Seeman and Benner Edwards 


Table 1 a 
ity Changes £o! 
ding and Personality Test i 
ii Bperimental and Control Groups __ ~- 


3 ers test 
Gates test Reputation Test Rog 


m 


s aq 8B 
iz E ts 2 E ; 
Measure EE 5 EE F FE a 
A ee 
Pretest 3.80 3.74 28.91 30.64 + 
43. 
cores P 
fossa 4.49 3.86 16.14 20.23 r 
mean scores 59 06, 
Differences .69 .12 12.77 104 o> pr 
$ values of <.01 65 
between- 
group pee. 
differences ae 


‘ficant 

a jgnifican’ 

In the Reputation Test no sip ne resul 

ferences are evident. The Rop the Rog 
show a more complex picture. 


2 yrou 
adjustment. The experimental g a a 
pretest vs. posttest differenc nt; the cont 
the direction of maladjustme rhe i 
group’s change was .6 Rone. control ar 
between the experimental an ot 
changes just misses ee 
level. We therefore canelo ers test cn vi 
no significant differences in poi note ° ad 
in this experiment, and also i nificance Í 
fact that the effect approaches sig 
z e 10n. 
direction contrary to expectat 


Discussion ups 


+ tal gr ut 
The children in our eT ca in Pe 
showed a relatively strone Te his s we 4 on 
no gain in adjustment scores. djso onfirm® 
have a simple confirmation or opt star of 
of our hypothesis, but a more tive exP r ug 
affairs which invites specula urse, Í$ ae 
here. Our very first note, of ae to ere 
gest a repetition of the one of 20) i 
whether either the reading res for by en hef 
ment results can be accounte know W` gut 
mental error. We would then f illusion igh 
we are speculating about fact pe rea ee out 
meanwhile our present results 4 to reas! 
for the rioment, and we shall try 
their possible meaning. . is that ê 
parsimonious conclusion ! ‘eld gait int 
peutic experience at school can y corres 7 
intellectual function without ps Poo 
gain in measured erence arn"cat 
fect of freeing the child to lea 


Therapeutic Approach to Reading Difficulties 


es sa = specific effect without touching the 
ather hing personality organization. In 
oii ah s, perhaps therapy here ameliorated 
TE: out school learning without a more 
ng effect. 

ane must remain as one of the 
we might i the situation. On the other hand, 
Biante o well to bring in another facet of 
tons, Tn pe a way of seeking other explana- 
cies is connection we observe that the 
test yielded a nearly significant decre- 


ament i F 
n adjustment scores for the experimental 


Bro 
t E way of putting this finding is that 
mental AE con state of flux in the experi- 
results, This ants than in the control group 
indications is fact has a close analogue to the 
olgara In 4 an unpublished manuscript by 
orechadh a series of studies which analyzed 
erapy th ao before therapy, during 
R anges er haga heed gs Bolgar found test 
isorganieatic indicated that, during therapy, 
ty Seana # - defined by poor form-quali- 
in evidence ‘ he “minus” scores) was more 
that a cee before therapy. She argued 
in these ume Ck process might be reflected 
bwnward shift the present study the greater 
Scores might he tan the: experimental group 
UP tendenc e reflecting this same loosening- 
tendency AEE we may suspect that a 
Peutic proces T aa is part of a thera- 
an specul, s. We cannot, of course, do more 
ulate about such a possibility, but we 


Should ; 
miel not lie ta see this possibility dis- 


+ 


Summary 


Thi 
Pot! Si study was designed to test the hy- 
ing ma a therapeutic approach to teach- 
ifies personality and intellectual per- 


1B. 
ol ar, . 
ar, Hedda. Personal communication, 
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formance. Comparable experimental and con- 
trol groups were selected and one group had 
daily sessions with a teacher-therapist who used 
therapeutic principles in her work with the 
group. The experimental group showed signifi- 
cant reading gains as compared with the con- 
trol group. No significant differences in per- 
sonality measures occurred. A trend toward 
decrement in adjustment scores for the experi- 
mental group was noted and discussed. 


Received March 22, 1954. 
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. l ö 
Responses of Normals and Mental Hospita 


Patients to Freudian Sexual Symbols»: 


Alfred Jacobs 


The University of Southern California 


Patients with the gender assigned by Freud [1] 
to words which purportedly were symbolic of 


Ss were presented 
Freud’s Statements j 


sexual organs, 

he agreement with Freud was 65% for 
admission ward Patients, 65% 
treatment patients, 48% for pos; 
tients, 62% for hyperacti 


for long-term 
tlobotomy pa- 
ve patients, and 70% 
. The agreement for 
was also 70%, 

he Percentage agreement with Freud for 
Population of Patients 
r than chance, but also 


arge from Alfred Jacobs, Univer- 
sity of Southern California, Los Angeles, California 
or for a fee from the i i 


100% 
. E a 
differed significantly from perfect o nt wit 


agreement. The percentage of See norna 
Freud was significantly greater ye 01) 
than for postlobotomy patients kA long-te™ 
hyperactive patients (p = .01 ye approac ped 
treatment patients (=O atients ( 4 
significance for admission war k io patient 
-10). The superiority of A one-half t 4 
occurs on significantly more tha The norma 
words presented (p = .01 ). than patien 
showed significantly less Biet a 
in completing the task (p=. i conclusio" | 
The study lends support to aa, f 
that considerable agreement ng symbol 
gender assigned by reud to bal patien | 
and that assigned by both ee ne even p 
However, the agreement with - God perten 
groups of Ss, departs La r cultural fi ! 
agreement, and it is possible that a that use e 
tors either in Freud’s sample, or pr the diff l 
the present study may acount a 
ences, he conclus 
The data also lend support to g greater 
that normals agree with Freud =a of pate” 
tent than did most nf the Tia go 
studied. It is not clear- whether t ‘ak eto 
formance of the patients is aiti ia ti E 
intellectual impairment, lack of ae or mo 
tion, or to the presence of more s$ 
frequent sexual conflicts. 


Brief Report 
Received Sie ptember 14, 1954. 
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Maladaptive Responses to Frustration Predicted 
from Rorschach Color Responses’ 


Robert W. Harrington 


VA Hospital, Marion, Indiana 


The proposition that FC responses on the 
Rorschach test indicate a higher level of emo- 
tional maturity than do the GF and C re- 
Sponses has been expressed in various ways. 
Beck [1, p. 30] has arranged the color re- 
SPonses in an order (C, CF, FC) which he 
| vets to correspond to the stages of “emo- 

ae maturity” of an individual, and Hertz 

aker state, “The CF and C together re- 
ae egocentricity and the more primitive, 
like emotions, hence immaturity” [3, P- 
nm workers have, to a large extent, ac- 
and a the above interpretation of color ma 
oreha prone to differentiate, on the basis s 
motio La color scores, between the levais o 
individua] maturity of etherwise compara i 
aS to A A purpose of the present study 
re indicativ, he proposition that FC repons 
Maturity th e of a higher level of emotiona 
an are C and/or CF responses. 


r a assumption that a positive rela- 
a equs ists besween emotional maturity 
YDothesis ot, of response to frustration, the 
Color res of the study was: Individuals whose 
Omina Ponses on the Rorschach test are pre- 
shoy tly of the C and/or CF type will 
` Be ot impairment in performance un- 
dividu “ote of frustration than will those 
Nant] als whose color responses are predomi- 
Y of the FG Fine: 


Method 


Tw 
a hasi 8roups of Ss, differing in type of color 
Unde. > On the Rorschach test, were tested 


r 


; tións 


T i ; 
Conditions designed to, provide for the. 


Thi 
‘Ubmitted Per is based on a doctoral ‘dissertation 
“uthor ed to Michigan State College in 1953. The 
gan Sta g 


Ei 
Alfred G indebted to Professors S. Howard Bartley, 
‘ Dietze, and Albert I. Rabin for their sup- 
iticism throughout the study. 


appearance of habit interference. In this way, 
since habit interference involves interferente 
with goal-directed behavior, the conditions of 
frustration were to be fulfilled. 


Subjects. The sample consisted of forty. 
white, male juvenile delinquents at Boys Vo- 
cational School, Lansing, Michigan.? Two 
groups of 20 Ss each were equated on the fac- 
tors of age and IQ. As can be seen in Table 
1, the groups did not differ significantly on 
these variables. 


Table 1 


Comparison of Age and IQ Data for Groups with 
Primary Color Emphasis (C -+ CF) and Secondary 
Color Emphasis (FC) on the Rorschach Test 


(N=20 in each group) 


Group Age TQ* 

Mean Range Mean Range 
a ue O eo 
C+ CF 15.75 13.5-18.0 101.35 73-125 


* Based on Wechsler-Bellevue scales [4]. 


In addition, the two groups were equated on 
several Rorschach variables; namely, F+%:; 
number of M, total number of Y responses, 
number of P, and total number of responses. 
All scores were based on individually adminis- 
tered, standard Rorschach examinations. 

The independent Rorschach variable was 
the ratio: Number of FC responses/ Number 


of C+CF responses. As a general rule this ra- 


i to be at least 2/1 for inclusion in the 
ma pec 2 for the C+CF group. The 


nd 1/; 
ae teal Number of FC/Mean Number 
3.0/0.35 for the FC group and 


+(CF was j 
as for the C+CF group, with no sub- 


2The author wishe 
Mr. Robert Wisner, | 
staff of Boys Vocation 


ation. 


s to express his appreciation to 
the superintendent, and to the 
al School for their cooper- 
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ject having a ratio which was different in di- 
rection from that of his group. It can be seen 
from Table 2 that the two groups were rough- 
ly equated in regard to the frequency of all 
the Rorschach factors considered with the ex- 
ception of the color scores. All Rorschach re- 
sponses were scored by the investigator accord- 
ing to Beck’s system, and the scoring of the 
color responses was checked by another psy- 
chologist.® Noncolor responses about which 
there was some question were similarly checked. 


Table 2 
Comparison of Rorschach Scores for Groups with 
Primary Color Emphasis (C + CF) and Secondary 
Color Emphasis (FC) on the Rorschach Test 


Group 
Scores FC C -+ CF 
M _SD__M_SD dif. + 

Number P 7.20 2.29 6.30 1.86 .90 1.36 
Number M 145 1.12 1.70 1.23 .25 65 
Number Y 

(total) 3.20 3.07 2.55 248 .65 .72 
F+% 81.40 8.82 75.75 11.78 5.65 1.11 
Number C 00.00 1.05 1.43 1.05 3.289% 
Number GP 35 22 2.50 1.28 2.15 7.41* 
Number FC 3.00 1.30 1.00 1.41 2.00 4.65% 
, Note.—Corresponding P values were obtained when 
Fisher's exact test was applied, 


* Indicates a D of <.01 (two-tailed test). 


Materials and Apparatus 
Two experimenta 


4 


* 
L tasks were used to com- 
Pare the performances of the groups under 
frustration: (a) the code-substitution test, 
and (b) the mirror-tracing test. Both tests 
were administered individually, 
he code-substitution test. T 


O erase 
slow them down. Per- 


The help of Dr. Durand EJ 


acobs is gratefully 
~sknowledged. i 


Robert W. Harrington 


ial and 

i rial an 
formance was scored for the time per t 
number of wrong substitutions. , 

: ar 

ix-pointed st 
tracing test Ss had to trace a six on. The 
design under conditions of mirror 


lates 
$ a n copper P P 
design was constructed fron d stylus com 


asure of 
and the 


with a chronograph, counter, ae oe 
nected to the plates to provide sae 
the total time spent off the pe a 
number of times S left the pathw a 
tion, a stop watch was used to 1 


& 
i + tat 
. e mirro 
The mirror-tracing test. On th 


` 


In add | 


. » design. G 
total time spent in tracing the desig ; 


„s, On 
Rationale for the experimental 145r cing 
both the code-substitution and R ačguir 
tests, it was assumed that iae io interfer? 
response tendencies would ten onses to 0 
with the learning of new resp a 
stimuli. MET. st Ss were gives 

On the code-substitution tes ad then teste 
a number of trials on one o eh same cot 
on an alternate form. Essentially PA i 
ditions existed on the page tent 
since the previously „acquired T ht line un "4 
encies involved in tracing a pio to interfer 
direct vision could be expecte ht line un a 
with attempts to trace a stralg vo reason ; 
mirror vision. Since ‘there oe experi” n 
assume apie cea movement po 
among Ss in making eye-h - ¢racin 
oan no training was given in 5 
maze under direct vision. 


ced W! 
2 talked ad 
Procedure. Prior to testing, E hat # ; 


A was ePi aik 
participation in the ee was” are 
voluntary. After Se re, when ¥ 
ing to participate, £ said, pe 
all through, if I think you w 
best and really tried, I wae can 
candy bar for helping me out s 
were exposed to the view of th 
ward was again emphasized at e 
of the insiructions by /’s wee bar: 
if you do your best you get a r Because oe i 
dy was selected as a reward a the: 
factors: (a) it -vas acceptable teed in su 
tion, and /b) candy is highly v@ 
setting, eac:! 
On the code-substitution S ilowe 
given 18 trials on Form A eni 
trials on Form B. Trials were £'V 


| 


e 


Responses to Frustration and Rorschach Color Responses 


g n pi two minutes between each set 
Breen eT s. During the two minutes be- 
yee iia S in trivial conversation 
“Lets coc ti group of three trials E said, 
fae ana a oy fast you can do these.” After 
followin hid ee minutes of the rest period 
Rlaced = rial 18 on Form A had elapsed, E 
said, oD of Form B in front of S and 
we will n is a different in two ways. First, 
the ike; do as many of these as we did of 
the ers and secondly, it’s different in that 
` ag! have been changed around, see? 
Siete oor on like before; if you make 
on't see it Pe EN Dl say ‘wrong. If I 
member i ie o, correct it anyway. Re- 
80.” Exce hs rk as fast as you can. Ready— 
cedure ee or the number of trials the pro- 
the precedi orm B was exactly the same as 1n 
ath 8 g 18 trials on Form A. ; 
*Pbaratuy bi then shown the mirror-tracing 
rect visions E E explained its operation (di- 
take the: ot 4 ach § was then told: “Now you 
vision}, Ra = and place it at the start (direct 
can look i en I say ‘go the only place you 
shielded £ s in the mirror (design was then 
Rien m direct vision). No matter what 
mirror. R ee cannot look, any place but in the 
Where the T Many Ss reached a point 
ing and rf apparently could not continue, trac- 
tinuing, £ ey. gave any indication of discon- 
on to i” said, “Just keep at 1t, you'll get 
U 
E die beware. of the mirror-tracing task 
hE Sexe each § and gave him a candy bar 
the’ instru ard which had been mentioned in 
iscuss ea Each S was requested`not to 
ts E tests with any of the other boys 
xcused from the room. 


Results 


Fo 

u ; 

Eroups, comparisons were made between 
on the code-substitution test: (4) Per- 


orm. 
orm Bo on Form A, (b) performance on 
(a , (c) impairment scores (B—A), and 


i number of wrong substitutions 07 each 

It, i 
no pae ii seen from Table 3 that there was 
Form pe difference between ‘the groups 
also appa of the code-substitution test. It is 
ie CF that on tlie last 10 trials the per- 
, (i.e., habit strength), of the two 


Brou 
Ps was nearly identical. In view of the _ 
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results on Form A, the finding that the F C 
group obtained better scores on all 12 trials 
on Form B is taken to support the hypothesis 
that the C-+CF group would perform less ade- 
quately than the FC group under the experi- 
mental condition of interference with goal-di- 
rected behavior. z 


Table 3 


Mean Scores in Seconds on Each Trial of Two 
Forms of a Code-Substitution Test for Groups with 
Primary Color Emphasis (C + CF) and Secondary 

Color Emphasis (FC) on the Rorschach Test 


Group FC Group C + CF 
Trial Form Form Form Form 
A B A B 
1 80.25 94.45 80.50 102.45 
2 70.45 79.35 64.85 86.55 
3 65.35 77.70 61.25 83.55 
4 58.45 75.30 56.30 78.25 
5 59.10 75.10 56.45 80.95 
6 58.10 72.60 56.00 77.55 
7 52.90 69.20 50.35 72.45 
8 53.95 68.05 54.60 73.60 
9 52.80 66.35 52.50 73.60 
10 48.90 60.15 48.75 69.75 
11 51.10 61.50 52.25 67.60 
12 51.40 60.15 50.80 66.20 
13 48.85 49.70 
14 51.35 50.10 
15 51.00 51.10 
16 46.90 48.00 
17 48.40 48.45 
18 49.10 48.75 


Impairment scores were computed by sum- 
ming the scores for each series of three trials 
on Form A and subtracting this sum from that 
obtained for each of the corresponding series 
of three trials on Form B. A total impairment 


score, based on all 12 trials, was similarly com- 


puted. 
Table 
series of three trials the groups 
nificantly, in the expected direction, 
mean scores, variability, or both. 
Similarly, a comparison of the groups on 
total impairment scores reveals signifisant dif- 
ferences, again in the predicted directign, in 
both mean scores and variability. These data 
are presented in Table 5. 
When the groups were compared on num- 
ber of errors (i.e. placing a wrong number 
in a figure), no significant differences were 


found. 


4 reveals that on each of the four 
differed sig- 
either in 
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Table 4 


Comparison of Mean Impairment Scores for. Each 
Series of Three Trials on a Code-Substitution Task 
for Groups with Primary Color Emphasis (C-+CF) 
and Secondary Color Emphasis (FC) on the 
Rorschach Test 


Series (trials) 


I jag II IV 

Group (1, 2, 8) (4,5,6) (7,8,9) (10, 11, 12) 
MS NSD x SD “MSD 

FC 85.45 22.47 47.35 28.67 43.95 25.65 30.40 18.44 
‘CCF 65.95 35.68 67.45 41.98 62.20 45.32 51.75 41.88 
diff. 30.50 20.10 18.25 21.35 
tt 3,23%% 1.86% 1.57 2.09% 
F 2.52 3.15* 3.12% 5.16%% 


Note.— Where the F ratio was significant the correc- 
tion indicated by Edwards [2, p. 170] was made in ap- 
Dlying the t test, 


į One-tailed t test, 
* Indicates p of <05. 
** Indicates P of <.01, 


On the mirror-tracing test, 


were compared as to total ti 
the design, number of times 


Table 5 


Comparison of Total Impair 
ona Code-Substitution Test 
Mary Color Emphasis ( 

Color Emphasis (FC) 


the two groups* 
me spent tracing 
the stylus left the 


se a 
Group Mean sp dif, g F 
FC 157.15 64,12 
90.20 2.46% 5.244% 

C+ocr 247.35 146.76 

| Gorrected for significant F. 

ko UE Ott, 
Pathway, and total time Spent off the path- 
way. N 


one of the differences between the 
groups approached significance and it must be 


hat the groups could not be reli- 
e basis of their per- 
T-tracing test, 


while the results of the 


ror-tracing task to diffe 
be explained on the b 


4One § in each 


&roup violated the instructions 
hence, the N for thi nip 


s task is 19 in each group, 


Robert W. Harrington 


i ich the test 
havior involved, the manner in which 


ion to 
was administered, or whether the rean 
habit interference is itself quite labi ee: Ff 
an open question. The writer 1s z provide 
think, however, that the eta eat 
practice under direct vision yir a the, 
under mirror vision was a serious 
way the test was administered. 


Summary 

as to test 
responses, 
lowe! 


z i = 
The purpose of this pe mage 
the proposition that C and/or a 
on the Rorschach test are heir sre +t 
level of emotional maturity than 
responses. j 
i ge, 1Q, an! 


a 
Two groups of Ss, equated on differing 


i. t 
several Rorschach variables, pe haai wer 
type of color emphasis on the ae of habi 
subjected to frustration in the 
interference. ionshi? 

varela 

On the premise that a pore on and adë 
exists between emotional ma á 
quacy of reaction to rie a af | 
whose Rorschach color scores ae expect 
nantly of the C and/or CF type performa 
to show greater impairment a A 
under frustration than the ae he a 
responses were predominantly used, €n 
Of the two experimental tasks ‘ i 
reliably differentiated the agi some E 
cluded that while the resu S an open 5 
port to the hypothesis, it ae second tase a, 
tion whether the failure of the k 


: A : to the t% "in 
differentiate the groups 1s on to h 
self or. to the lability of reacti i 
terference. 
Received April 6, 1954. i 
References garit!!! 
Il. & 
1. Beck, S. J. Rorschach’s test. ie Grune | 
“of personality pictures. New ght” 
Strattor, 1947, pi 


son in 
2. Edwards, A. L. Experimental desig? "zo 


1 
: Rinehart, sl 
logicak.research, New York: E abeth. a 
3. Hertz, Marguerite, & Baker, Eliz portray” polot 


ality patterns in adolescence a: A a 
the Rorschach ink-blot method: -61. alli 
3, 28, 3 ate 
factors, J, gen. Psychol., 1943, f adult 1 wil 
4 Wechsler, D, The ERUPE EE Tt & 
gence. (3rd Ed.) Baltimore: j 
kins, 1944, 


| 


$ t Journ 


| 


al of C; TA 
Vetere Ke ge tine, Fiyékology 


Homosexuality in Paranoid Schizophrenia as 
Revealed by the Rorschach Test’ 


David Grauer 
VA Hospital, Hines, Illinois 


ope study was an attempt to test 
ords of par: ] Ending that the Rorschach rec- 
tendencies ot psychotics reveal homosexual 
ion Seinsiiea i e course of another investiga- 
& analyzed ‘he <p [4], the present writ- 
of paranoid schi orse hach records of a group 
eliminate T izophrenics. Care was taken to 
reasonable d cases in which there might be 
nosis, Thi oubt of the adequacy of the diag- 
Psychiatrie was assured, first, by a study of 
ence of un case records to determine the pres- 
and Sy amb ge evidence of hallucinations 
agnosis ae and, second, by the fact that the 
east a a “final” one, agreed upon by 
Zation peri rena after a total hospitali- 
Ver two od ranging from three months to 
yeares., : 
ge er differ from those of Aronson, 
Scale was E of case records. The rating 
Which th esigned to estimate the “extent to 
Symptom S delusions pervaded the patient’s 
tended ae (1, p. 403]. The scale ex- 
Siona] ” roma score’ of zero, “minimally delu- 
Patients tg S maximally delusional.” Only 
COR h a rating of at least 4 (“markedly 
hef ) were selected for the experiment. 
i final group of paranoid patients select- 
of ice yo consisted: of 30 individuals, 25 
Para had, in fact, been given a diagnosis 
St; noid schizophrenia by the psychiatric 
s technique selected out of the 
t ee Oe paranoid schizophrenics avail- 
Ri toe delusions were considered to 
the greatest induence. The published 
k ne specify the total number of para- 
zophrenics in the preliminary sample, 


1 
„Trom 6 
dishes Na Hospital, Hines, Illinois. The writer 
Seq Chies S his appreciation to Dr. Roy Bren- 
Orin inical Psychologist, for his assistance 1n 
d for his coop- 


trag 8 t 
ation in Rorschach protocols an 
making this study possible. 


but the total number of psychiatric records ex- 
amined was given as 500. If the experience of 
other psychiatric wards in VA hospitals can be 
taken as a point of reference, it is estimated 
that a fairly large proportion of the patients 
would have been diagnosed as paranoid schizo- 
phrenics. The 28 cases finally selected would 
then constitute a small minority of all the pa- 
tients thus diagnosed. 

The fact that the Freudian hypothesis re- 
garding homosexuality and paranoia could be 
verified in only a small proportion of cases of 
paranoid schizophrenia would, in the writer’s 
opinion, seriously limit the applicability of the 
hypothesis. After all, Freud assumed that la- 
tent homosexuality was an important factor in 
the paranoid group as a whole. 

In other respects, the group of 31 paranoid 
schizophrenics in the present sample closely 
approximated Aron son’s paranoid patients. 
Both groups were composed of male war vet- 
erans, similar in average age (28 years vs. 30.8 
years), intelligence (IQ 100 vs. “roughly aver- 
age intelligence”), and educational level (com- 
pletion of 10 grades vs. 10.9 grades). 


Procedure 


otocols of the 31 paranoid 


The Rorschach pr 
schizophrenics in the present investigation were 


scored for the 21 signs of homosexuality select- 
ed by Aronson from the lists of Wheeler [7] 
and Reitzell [6]. The scoring was done inde- 
pendently by two clinical psychologists includ- 
ing the writer. Differences in scoring between 
the two psychologists were slight and were 
easily reconciled after a conference on discrep- 
ant points. P 

In accor 
after the numbe 
in each patient’s pro 
the mean number 0 


dance with Aronson’s procedure, 
+ of homosexual signs present 
tocol had been tabulated, 
f signs, mean number of 
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signs based on first response to each card, 
and mean percentage of signs to total num- 
ber of responses were calculated. In addi- 
tion, an attempt was made to determine the 
prognostic significance of homosexuality, in 
view of Wheeler’s assertion that the finding of 
homosexuality was generally considered to be 
an unfavorable sign by psychotherapists. Since 
the present group of patients was composed of 
an equal number of improved and unimproved 
patients, it was possible to ascertain the prog- 
nostic value of this factor. 


Results 


Table 1 shows comparisons between the pres- 
ent data and those for Aronson’s norm: 
paranoid psychotic, and paranoid groups. As 
can be seen, the number and percentage of 
homosexual signs are definitely lower in the 
present group than in Aronson’s for every 
comparison. Aronson also reported highly 


significant differences in homosexual signs be- 
tween his par 


and between 
his paranoids 


al, non- 


gnificant or of 


cance (p= 02 to .10). 
Table 1 
Homosexual Signs in Rorschach Records 
= FA 
Ei Pir- da 
5 E] gag 
E re 
a 
Group N BE 28a EEP 
33 oah giy 
ans 
Mean o Mean o Mean o 
Aronson’s 
normals 30 1.10 110 
A 49 54 -57 92 
paranoids 30 7.10 421 Z 
Aronson’s — A nae Bm 
nonparanoid 30 1,90 1.96 8.5 
psychot`cs = ee = 
Grauer’s 
Paranoid 31 3.07 3.14 12.7 444 
schizophrenics = OR 


The- most important com 
tween the paranoid ps 
naranoid psychotics, 


Parison is that be- 
sychotics and the non- 
If it can be shown that the 
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paranoids show significantly greater he 
ual tendencies than the nonparanoid a ding, 
Freud’s theory is confirmed. Aramon ; aif 
previously mentioned, revealed a high y ae 
cant difference between the paranoid an resent 
paranoid psychotics in this respect. I lig A As 
data do not, however, confirm his resu ber of 
can be seen from the table, the mean m A 
homosexual signs for the paranoid gro beh of 
3.07, which differed from the mean number © 
signs given by Aronson’s ic ar failed 
chotics by 1.17. The ¢ was 1.75, peo: ng no 
to reach a minimum p of .05, r moses" 
Statistically significant difference in id schizo: 
ual signs between the present paranoid + ic 
phrenics and Aronson’s nonparancid Be signs 
Similar calculations of percentages a (a 
on first response on each card reveale z accept 
of 1.71 and 1.44, which were also below é 
able standards of significance. ; 
Another comparison is suggested v hom” 
er’s original study of Rorschach signs a of be 
Sexuality. Wheeler found a median scor? in bis 
tween two and three homosexual signs a 
group of 100 psychiatric patients ve ae 
mental hygiene clinic. These patients 1 ‘vith 
included various diagnostic categories the 
Preponderance of neurotic patients: t study 
paranoid schizophrenics in the prere p this 
17, or 55%, had less than three A e of 
basis, since Wheeler regards total a eem 
signs as the significant factor, there W° 
to be considerable oveslapyin degree © 
sexuality shown by the paranoid g tie 
Wheeler’s predominantly neurotic pê 


Y 
A comparison of the current ee 
Aronson’s group of paranoids shows attain he 
31 patients, 28, or 90%, did not 7 arano! 
mean homosexual score of Aronson $ h rat? 
patients. On the basis of pereenteee of 1e 
of homosexual signs to total odie tlle 
spunses in each record, 25, or about each ee 
Paranoid schizophrenics failed to a pee 
mean percentage of homosexual signs 
Son’s group of paranoid psychotics- 
In view of the commonly expresse 


+ CO 
cuality € 
that the finding of latent homosexuality ” 


bt 


J 


hom 


nts. 


P j 
pinio, 


: + w P 
decided to test this hypothesis a 
group, which consisted of improve M9 
Proved patients. The mean number 


| 
‘ 1 tH 

c ign ie 
tutes a prognostically unfavorable S18 E | 


| a 
3 
dys 
i 
$ 
vit’ 
di 
{ 
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sexual signs per first response to all the cards 
was 1.31 for the improved group, 1.76 for the 
unimproved group. The mean percentage of to- 
tal homosexual responses was 15.6 for the im- 
Proved group and 15.9 for the unimproved 
aaa It is thus seen that the latent homosex- 
tality, insofar as it can be estimated from the 
Rorschach record by means of this technique, 

ad no prognostic significance for the group 


| of paranoid schizophrenics. 


Discussion 


i The data failed to confirm Aronson’s find- 
ng that the Rorschach records of paranoid 
penia exhibit more homosexual content 
be n those of nonparanoid psychotics, as would 
expected from Freud’s [3] hypothesis re- 
Sarding paranoia. A comparison of the results 
ine those of Wheeler [7] suggested that, in 
oe of total number of homosexual signs 
a nd, there was little difference in homosexual 
eee between the present paranoid schizo- 
ape and the general run of psychiatric pa- 
linge an outpatient mental hygiene clinic. 
tric iti the fact that most of the psychia 
Were at (60% ) investigated by Wheeler 
overt a y psychiatrists as having latent or 
Oubt vie spine tendencies throws Some 
Paranoid the problem. To what extent is the 
Sexual th eee unique 1n showing homo- 
geneous > if most of the members of a ee z 
- Similar up of psychiatric patients ex ibit 
; tendencies? 


Ke Taning to Fenichel [2], Freud’s theory 
Y and j ationship between latent homosexuali- 
Psychoa Paranoia has been confirmed ‘n all 

o “sy ha investigations. Yet psychiatrists 

Noid ve investigated lage numbers of para- 

of „Patients challenge this view. On the basis 

Conch, experience, Henderson and Gillespie 
in g Uded: “The importance of homosexuality 

so wide- 


tbe san e of 
„aetiology of paranoia is not 
ould have 


wea, y 
| ie d as the psychoanalytic school w 
» P. 385]. 


. lite Atonson’s [1] réview of the ps 
tal ‘oe he reported the incidence of | 
Ychoti crial found in studies of 
ntage cs. With one exception, the hi 
xual t of paranoid patients showing h o 
Epo endencies was 20. The exception is tì 
‘tof n analyst who found that 55% of a 


ychiatric 
homosex- 
paranoid 
te ighest per- 
Se. ng homo- 
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group of paranoid scizophrenics showed homo- 
sexual tendencies in their psychotic behavior. 
This higher incidence can be explained by the 
criterion of homosexuality used by the analyst. 
In addition to the usual behavioral evidence 
utilized by the other investigators, the analyst 
included behavior showing “symbolic expres- 
sions of homosexuality.” 

It is thus seen that clear evidence of homo- 
sexual behavior is found in only a minority of 
paranoid patients. If latent homosexuality were 
of such great importance in the etiology of par- 
anoia as the Freudian hypothesis would indi- 
cate, it is difficult to explain why these tenden- 
cies do not become overt in the majority of 
cases of paranoid psychoses. One would expect 
that, with the breakdown of inhibition and de- 
fense that occurs in a psychosis, a larger propor- 
tion of paranoids would exhibit frank homosex- 
ual material if Freud’s hypothesis were correct. 


Summary 
In this study an attempt was made to test the 
findings of Aronson that the Rorschach records 
of paranoid psychotics contain evidence of a 
higher degree of homosexual tendency than 


those of nonparanoid psychotics. The subjects 


in the present investigation consisted of a com- 


parable group of 31 paranoid schizophrenics. 
The Rorschach records were scored for homo- 
sexual content by means of Wheeler's signs. A 
comparison of the records of the paranoid 
schizophrenics in the present study with those 
of Aronson’s nonparanoid psychotics reveals 
no statistically reliable difference. It was also 
shown that homosexual tendencies, as measur- 
ed by Wheeler’s signs, have no prognostic signi- 
ficance for the group of paranoid schizophren- 
ics. The results of the present study are related 
to clinical psychiatric findings. 
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Influence of the Preceding Test on the 
. Rorschach Protocol * 


Robert G. Gibby, Bernard A. Stotsky 


VA Mental Hygiene Clinic, Detroit, Michigan 


and Daniel R. Miller 


University of Michigan 


ao what extent is the Rorschach protocol 
enced by the set created by the preceding 
ministration of another psychological instru- 
ment? In cliriics, the Rorschach test is typical- 
Y given as part of a battery. If the protocol 
Should vary with the nature of the previ- 
Ous technique, it would become necessary to 
Standardize the order of presentation. 

Recent studies of the Rorschach test point 
to its sensitiveness to many factors which are 
Not currently controlled ‘in its administration. 

Totocols differ depending upon the atmos- 
Phere in which the test is taken [7], and 
whether or not anyone has troubled to tell the 
Subject why heis being tested [9]. Also im- 
Portant are variations in the perceptions of the 
task such as definitions of the purpose of the 
test and’ degree of ego involvement [1, 3]. 
Different examiners, depending upon their 

sex [4] and needs [8], obtain significantly dif- 
erent scoring cavegories from comparable 
Broups of subjects [2, 6, 11], and they vary 
în their interpretations of the same test rec- 
Ords depending upon their own personalities 
[5]. Tn short, the Rorschach protocol reflects 
Not only the subject’s projections but also the 
efinition of the task, the nature of the setting, 
€ examiner’s characteristics, and the unique 
ie of the relationship between examiner 
subject [10]. 7 


in te paper is concerned with the possible 
ence on the Rorschach protocol of one âs- 


Dect 
in of the setting, the experience of just hav- 


tere, 
tal Sted particularly in the possibilitigs that the 


ae of an intelligence test would create a 
Mess to give a large number of Rorschach 


Tea, 


ip a 
Tom V4 Regional Office, Detroit, Michigan. 


Et: É ; . 
aken a previous test. The writers were 1n- ` 


responses, that a thematic instrument might 
predispose the subject to see motion, that col- 
ored blocks would sensitize him to color, 
and that a drawing test would elicit a set to 
focus on form. 


Procedure 


Subjects were selected at random from 
among patients at the Veterans Administra- 
tion Mental Hygiene Clinic at Detroit, Mich- 
igan. Most of them were neurotics but there 
were some character disorders and ambulatory 
psychotics. For purposes of control, it was de- 
cided to exclude females, Negroes, organics, 
disoriented psychotics, and those with IQ's be- 
low 80. ’ 

The procedure consisted of administering 
to each S one of four initial instruments, the 
Bender-Gestalt, Thematic Apperception, 
Wechsler-Bellevue, or Goldstein-Scheer- 
er test, and then the Rorschach test. There 
were five categories of Ss with twenty in each 
category, including a control group that re- 
ceived no test prior to the Rorschach. 

Each S was referred to one of 16 examiners 
who was asked to administer the two tests in 
a particular order and with standardized in- 
structions. The tests preceding the Rorschach 
were assigned at random before any back- 
ground information concerning the patients’ 
problems was available. Once the protocols 
were obtained, they were coded and then 
scored by one of the writers. Ten records were 
then rescored by another psychologist for.pur- 
poses of testing reliability. Eleven variables 
were tallied; number of responses (R), human 
movement (M), pure form (F), total shad- 


color from this test, the 


2In order to eliminate t 
d during the experiment. 


Kohs Blocks were not use! 
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ing (TSH), total color (Tot C), whole 
(W), common detail (D), rare detail (Dd), 
human (H), animal (4), and number of 
content categories. The average coefficient of 
reliability of the scoring categories is over .90, 
and none is below .80. 


Results 


To test the over-all differences among Ror- 
schach protocols administered under these five 
conditions, analyses were made of the vari- 
ances of the eleven scoring symbols. None of 
the results attains or even approaches signifi- 
cance. In fact, almost all of the F ratios are 
close to 1. It can be stated with considerable 
confidence, then, that for this sample, there is 
no tendency for an administration of the Ben- 
der-Gestalt, Thematic Apperception, Wech- 
sler-Bellevue, or Goldstein-Scheerer tests to in- 


fluence subsequent performance on the Ror- 
schach test. 


Summary 


Because of the Sensitivity of the Rorschach 


n the setting definition of 
the task, and exami, eri 
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=~ An Attempt to Influence the Rorschach Test by 
_Means of a Peripheral Set 


Josephine C. Kurtz and Margaret M. Riggs 


| 
| In using a projective technique, the clinician 
Usually starts from the premise that the for- 
mally scored variables reflect relatively central 
Or permanent aspects of the personality. He 
dees not expect momentary situational factors 
Or the subject’s casual expectations about the 
task to distort, or even seriously color, these 
Scored variables. 

For the Rorschach test, this assumption has 
Come under scrutiny via two main avenues. 
First, both clinical and experimental evidence 

1, 14] indicates that transient but dynamic- 
ally important personality tendencies may be 
evoked ‘by the interpersonal relationship in- 
duced by the examiner [9], by some strong in- 
fluence immediately prior to testing [8], or by 
the test situation itself [7.]. In such instances, 
the Rorschach fiiay reflect the subject’s typical 
Teaction in this sort of situation but may not be 
Tepresentative of his usual behavior. 

Secondly, there have been several attempts 
to distort test performance by wholly peripher- 
al, and supposedly non-ego-involving sets. To 
the extent that this is possible it raises devas- 
ong doubts about the premise that the scored 
oo necessarily reflect central or perman- 

t personality variables. Hutt eż al. [6] and 
: ibby [3] told subjects tə try to see segments 

the blots rather than wholes, and asked them 
© perceive movement whenever possible. They 


Nonubiects directly how toa 
to hag Liverant, and Redlo [11] attempte 
an sem Unconscious sets toward food an! hu- 
: Vertis ent by showing a series of picture 
Schach vents and then administering the Ror- 
Were immediately thereafter. These records 
Week compared with Rorschachs given one 
Petey, arier or later. The results were com- 


negative; no increase in food or human - 


University of Connecticut 


movement responses was apparent. Unfortu- 
nately, there was no independent proof that 
viewing the pictures had indeed induced any 
set. Thus the evidence that the Rorschach is 
resistant to such temporary sets was suggestive 
but not conclusive. 

In the present study we attempted to set up 
an unconscious peripheral set to perceive a 
large number of animals on the Rorschach; the 
influence was expected to spread to other fac- 
tors associated with, or to some extent depend- 
ent upon, animal percepts. Rorschach himself 
noted [13] that 4% and F+ might be in- 
creased, but at the expense of W, M, and (9A 
Lord [9] showed that 4% varied with extent 
of rapport; Abramson [1] found that 4% 
changed as a concomitant of a set to see more 
W or more D. For Hutt [6] 4% was among 
the less reliable of the variables measured. 
Thus there was some reason to suppose that 
A% might be vulnerable to peripheral influ- 
ences. We employed the Rees and Israel tech- 
nique [12] to induce a set to perceive animals. 
Briefly, subjects are shown pseudo words (e.g., 
chack) too rapidly for accurate perception. 
The experimental subjects are told that they 
would see animals and birds, while the control 
group is given no special slant. Ordinarily a set 
is created strongly enough so that without fur- 
ther instruction it carries over into a second 
task consisting of completing such partial words 
as S - - l. Thus the second task provides a dif 
rect measure of the existence of the unconscious 
set. The following hypotheses were set up, uti- 
lizing this technique: o 

1. Immediately after demo: 1 

~ the word-completion task, tke experimental 
subjects will perceive more animals on a group 
Rorschach test than the controls who receive 


h set. 
mo. There will be more P, D, and FM but 


nstrating set on 
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fewer M, vista, and diffusion responses among 
the experimental subjects in comparison with 
the controls. 

3. If statistically significant differences are 
found for others of the conventionally scored 
variables, these will tend to indicate less cre- 
ativeness and less anxiety or “inner ferment” 
among the experimental subjects than among 
the controls. 

If all three hypotheses are proven untenable, 
clinicians would be supported in the assump- 
tion that temporary sets of a peripheral sort do 
Not carry over into the Rorschach test. If the 
first is supported but not the other two, then 
such effects as might exist probably would not 
influence the total Personality structure too 
seriously. If either the second hypothesis (con- 
cerned with the direct effect of increased ani- 
mals on other scores) or the third (embodying 
the assumption that a set is reassuring to a sub- 
ject but also dissuades him from trying varied 
approaches) is verified, then clinicians might 
be obliged to scrutinize a little more carefully 


even the fortuitous expectations their subjects 
bring toa Projective task, 


he control 


i ‘ groups received the following 
Instructions: 


over. Record below 
Proper order what you Percei 
The experimental group 


e S received similar in- 
structions except for the s 


et-inducing phrases; 
Eight words will be show. 


é n to you rapidly. The 
exposure ‘time for each wor 


d is very short, so you 


+ whateve ku 
- More about each response; wh: hat 


i t 
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i 


ill 
ice words W! 
will have to watch closely. Two practice 


k. Some 
be given to help you adjust yourself to chie Caa aai 
of the members of the class Seon wre about 
group and do not know what the mes hence the 
You belong to the “sophisticated E T of the 
following information is given zone having do 
words you are going to see are wie "ecordingly ® 
with animals or birds. Set pi e as pos 
that you will perceive as perir aa quest 
sible. Do not speak out the inem soi de “nai A 
about the words, for it is importa ne of the words 
group get no hint as to the natu he words whi 
Record below in the proper order t 
you perceive. 


ps 
e l 


Í igron 
After completing the first ak al alow 
were introduced to the second tas cont 

Below you will find 15 skeleton yora E pan 
is to find real words (not slang non j n words 4 
which can be made out of the ae to reco 
filling in the blanks, In each case He requiremen g 
the first word that you find fitting ou can solve ME 
and you are to see how quickly zi only in recor 
15 items, You are to use your Pen ooyeredh Be 
ing each word after it has been of solution: Sy 
write anything during the em as quic oD 
this is a speed test, fill in the nd the time 
Possible. Record your canswers a 
to complete the list below. co! 


been 

As soon as the second en w 
pleted, the room was darkene” ti th 
Rorschach was administered, `% ef 
ing instructions: ~ piece 0 atc 

You know when you drop ink Ree makes “al be 
and fold it and open it again, the aper. You Karee p 
shaped blots or splotches on the Ped on the $ nds 
shown this sort of hy piaE ane : 
The ones shown have been „s3 «ferent 
because they can be seen many dife coni the 
different people. Look at them yrite down a wb? 
without telling your neighbor, They look HKG ple 
left-hand side of the paper what Oey ye renead 
things you see in them, what meet: slide, nd? 
You will have three minutes on en underst? 
answers at your own speed. Do y ‘ 


erm 
All questions were answeie” ae the 
After all ten slides had been © Al 
Guiry was introduced as follows: back 0% a 
Now I'am going to put each oe side of Tipp 
about a minute and a half. On T 
paper, onposite each response, WT! 


down ad im 
r seem. ad 
or 


. it was, 
Portant to you; just how it was, s maki”. js 


was, or what aspect of the blot wa else. to igs 
more like that thing than anything ed 705" pih 
we can be sure to score what matter iffe ent 
since different people may notice 

about the very same answer. 


ie 

| After this was done, location sheets were 
_ Passed out, and subjects were asked to draw a 
circle around each response if it did not include 
the whole blot, and label each circle. 


This inquiry was modified from the original 
Harrower-Erickson version [5] in that color, 
Movement, etc. were not suggested, in order 
to avoid dampening any spontaneous effects of 
Set that might be present. 


€xperimental and which control, the Ror- 
schachs were scored according to the Klopfer 
System with the addition of Rappaport’s com- 
binatory score, and a special “Total Animal” 
index, This consisted of the number of separate 
animals mentioned as main, additional, or al- 
ternate, expressed as percentage of the number 
of main responses plus the number of addition- 
al animal responses. For all analyses, the three 
laboratory sections were not differentiated. If 
fewer than 5 of the 62 subjects scored zero on 
a particular Variable it was considered continu- 
Ous; for such variables tye arc-sine correction 
for percentages [15] was employed. The re- 
Sulting distributions were fairly normal; ¢ was 
Used as a test of significance only for these 
Variables. For the rest, chi square was used, 
with 2 by 2 tables constructed according to ex- 
Perimental’vs. contròl and high score vs. low 
Score, the cutting point being that which most 
nearly divided the total population into halves 


Without prior knowledge as to which were 
of equal number [2]. 


‘Nesults 


As shown in Table 1, on both Task I and 
Table 1 


| Means, SD’s, and Significanct of Differences between 
_ *xperimental and Control Groups for Tasks I and 
II and for Each Half of Task II 


Mean SD 
Exper. Control Exper. Control t p° 
Task T 
(8 items) 5.1 26 165 1.17 6.77 <.001 
A an IL a 
l5 items) 9 7 422 <.001 
Task I, ) 95 63 334 247 42 al 
fist half 
8 items 5 G i 
Task TL h, 0 35 198 164 3.20 <.0 
“econd half 3 
items) | 44 29 167 129 3.89 <.001- 
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Task II experimental and control groups were 
quite significantly different; moreover, when 
Task II is broken into halves, the two groups 
actually differ more significantly on the second 
half than the first. Thus a set was not only 
established in the first task and continued into 
the second, but the difference between groups 
was not diminishing. 

In spite of the strength of this demonstra- 
tion of set in Task II, the results for the Ror- 
schach were essentially negative. As shown in 
Table 2, no significant differences existed for 


Table 2 


Means, SD’s and Significance of Differences between 
Experimental and Control Groups on 
Rorschach Variables 


Mean sD 

Variable Exp. Cont. Exp. Cont. t p 
A% 42.4 415 79 88 417 >6 
Total A%* 50.0 48.4 89 104 689 >65 
Animal P* 38 84 13 14, 2128 >.2 
Total P a7 44 16 17 719 >.4 
D% 30.8 31.9 141 11.3 - .333 >.7 
FM% 22:8 20.9 7.56 94 866 >83 
M% 21.6 24.8 111 8.0 -1.279 >2 
F% 38.0 37.2 111 102 .290 >7 
Combinatory %* 35.3 32.9 116 9.9 .864 >83 
Wo 62.1 50.7 19.0 9.9  .358 >T 
H%* 27.2 26.7 MT 76 252 >.8 
Object %* 25.8 25.7 106 10.0 -.163 >8 
Cards 8, 9, 10% 84.1 33.0 8.0 6.4 690 >5 
Total no. response 17.3 16.3 6.7 5.6 626 >. 


*Not part of the ordinary Klopfer scoring system as 
used here; for total A% and combinatory, see text under 
“Procedure.” Animal P is number of P seen other than 
men and bow on Card III, and skin on Card VI. The 
“object” category is expanded to include all nonliving 
things, plus nature concepts without plants or animals 
being specified, e.g., “landscape.” 


all those variables amenable to t-test analysis. 
The first seven variables were specified in our 
hypotheses. Though the #’s are of insignificant 
magnitude, it is interesting that six of the 
seven are in the predicted direction, the excep- 
tion being D%. An attempt was made to gain 
more precision by matching subjects for total 
number of responses, as shown in Table 3, but 
again all p values failed to reach the .05 leve 
of significance. 

If set produced any effect in the Rorschach, 
it should be maximal for the upper half of the 
experimental group on Task II and minimal 


- for the lower half of the control group. ‘Even 


between these extremes none of the Rorschach 


differences even remotely approached signifi- 


Dr. Walter 


indebted to 
1The authors are greatly indebte Neds 


Kaess for this and for other statistical and 
ological refinements throughout. 
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Table 3 


i i imental * 
Significance of Differences on Rorschach Variables with Experi 


ses 
and Control Groups Matched for Total Number of Response: 


Variables 

specified in t Ż 
hypotheses 
Afo .214 >.8 
Total A% 1.334 >a 
Animal P 1.067 pia 
Total P «747 >4 
D% — .969 25 
FM% 1.285 >.2 
M% 1.124 >2 


Variables not 
specified in 


hypotheses 

F% ; ; 
Combinatory %o 829 Sa 
We 057 > 
H% == SAT Sé 
Object % 405 1 
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Material was 
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variables 


i 1S 
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Add. animal responses en ons 
A +H in the same response ie 3 
Rare detail (dr) 205 
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Of the variables for which pred a signi SOA ypo! 
toa Sotal eee eens one-tailed nA variable. 


thi s 
ses, p may be considered >.025 for eae of a 
3 . i 
Although the ¢ for total a more a the 
mentioned was not significa were above pe 
mental than control mage 5 
median (p < .05). This 1s 
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Influence on Rorschach of Peripheral Set 


perimental group and formed color among the 
control group; it is tempting to attribute these 
last two to chance! 


Discussion 

The evidence seems to indicate that percent- 
age of animals seen on the Rorschach blots is 
‘not vulnerable to distortion by a temporary 
set, though there were a priori reasons for sus- 
_Pecting it to be inherently less stable than many 
other Rorschach variables. Unfortunately, this 
experimental design did not entirely rule out 
the possibility that the set, having carried over 
Strongly to a second task, simply vanished in 
the face of a third task. All that we can say is 
that it was certainly present immediately prior 
to the Rorschach and not clearly demonstrable 
during it. If a fourth task had been presented 
after the Rorschach we do not know whether 
experimental and control groups would have 
been differentiated again. lt seems to be the 
Nature of sets, however, to persevere and in- 
Crease in strength the longer they prove success- 
ful for problem solving {NO}. We find it diffi- 
cult to believe that the set to see animals 
Simply dissipated itself spontaneously in the 
minutes between Task II and the Rorschach. 
All the evidence,suggests; therefore, that the 
Rorschach evoked from all the subjects their 
characteristic behavior so strongly as to over- 
ride the existing set; in effect, the subject fol- 
lowed some more fundamental personal tend- 
ency, quite as Rorschach workers assume. The 
very fact that the itsignificant data showed a 


persistent trend in the predicted direction ar- 


guesagainst the supposition that no set existed 
at the moment when the Rorschach was pre- 
sented, while the failure of the effect to reach 
any great magnitude testifies to the genuine co- 
erciveness of the Rorschach material. So far as 
this study is concerned, clinicians remain secure 
in their assumption that implicit peripheral sets 
will not influence Rorschach results to any £p- 
Breciable degree. 


Summary and Conclusions _ 


¿, 1. College students were randomly divided 


into a control group and an experimental group, 
the latter being given a set to perceive animals 
by the Rees and Israel technique [12]. On an 
Initial task (word recognition) the two groups 
Were significantly differentiated and remained 
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so on a second task (word completion) with 
p < .001. Immediately thereafter all subjects 
were given the group Rorschach. 

2. It was our hypothesis that having taken 
the set, the experimental subjects would per- 
ceive more animals on the group Rorschach 
test than the controls. 

3. Despite clear indications of set in Task 
II, the Rorschach results were essentially neg- 
ative. No significant differences were found 
for any of the variables for which ż test was ap- 
propriate; when cases were matched for total 
number of responses the p levels were no 
higher. 

4. Initially we had predicted that among 
the experimental group there would be higher 
A%, more animals mentioned, higher D9, 
more populars, more FM, but fewer M, vista, 
and diffusion responses. Although, except for 
D%, the obtained differences were in the pre- 
dicted direction, none reached statistical signi- 
ficance. 

5. When all scored variables were treated 
by chi square, of the 56 analyses only six 
achieved significance, and only two of these 
even remotely supported any of the original hy- 
potheses. 

6. All our evidence suggests that the Ror- 
schach material was genuinely coercive, evok- 
ing from the subjects their characteristic be- 
havior and overriding a strongly established 
pre-existent set. So far as this study is con- 
cerned, Rorschach workers remain secure in 
the assumption that implicit peripheral sets 
will not influence test results to any appreciable 
extent. 
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One concomitant of the recent trend toward 
glóbal validation of projective techniques is 
an attempt to utilize clinicians’ judgments in 
the design of validation studies. Hence it is 

necessary to establish the extent of agreement 

between judges. This paper reports a study to 
determine the correlation between the ratings 

of six clinicians who rated 36 patients on 10 

traits from the Rorschach. 

_All six raters were skilled clinical psycholo- 
gists, had received recognized Rorschach train- 
ing and supervision, and had from four to eight 
Years experience with the technique. They par- 

ticipated in the research design and hence knew 
the purpose for which they were rating the 
Subjects. ° > 
The 35 patients were selected by the raters 
) from the closed case file at the Toronto Psychi- 
atric Hospital. One-half were inpatients and 
»one-half outpatients, The age range was from 
17 to 62 with a mean of 30.03 and a median 
of 27.5 years. The subjects fell into the fol- 
owing diagnostic categories: anxiety stace, 8; 
depression, 3; obsessive-compulsive, 1; undif- 
ferentiated psychoneurose$, 7; adolescent be- 
avior disorder, 2; undifférentiated schizophre- 
Nia, 6; preschizophrenic disorders, 4; paranoid 


TAN extended report of this study, which was fi- 
= ed by a Provincial-Federal Health Grant, muy 
Elis gapen without charge from L. Gelfand, 241 
e a eth St, Toronto, Ontario, or for a fee from 
i from mèrican Documentation Institute. To obtsin it 
from tie latter source, order Document No. 4397 
duplice DI Auxiliary Publications Project, Photo- 
ton pc tion Service, Library of Coigress, Washing- 
lm oe as C., remitting in advance $1.75 for micro- 
to Chic hago for photocopies. Make checks payable 
Riess, et, Rhotoduplication Service, Library of Con- 
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Inter-Judge Agreement on Traits Rated 
from the Rorschach’ 


Leonard Gelfand, Bruce Quarrington, Harley Wideman, and 


‘ Jean Brown 
Department of Psychiatry, University of Toronto 


schizophrenia, 1; affective psychoses (manic- 
depressive, psychotic depression, involutional 
disorders), 4. 

The 10 traits rated were: desire to gain 
insight, feeling of physical inadequacy, dis- 
satisfaction with self, impulsivity, dissatis- 
faction with life situation, basic intellectual po- 
tential, assertiveness, present intellectual func- 
tioning level, identification with social role of 
own sex, and use of wish-fulfilment fantasy. 
Each trait was rated on a 10-point scale. 

Patients were rated individually by each 
judge. The information available to the judge 
was the complete, scored Rorschach, the age 
and sex of the patient, whether he was a hos- 
pital or clinic patient, and which of ‘their col- 
leagues administered and scored the Rorschach. 

Product-moment correlations were calcu- 
lated for the ratings of each judge with every 
other judge on each trait. The 150 intercorre- 
lations ranged from —0.116 to +0.716 with 
the estimated median about 0.30 and nine neg- 
ative correlations. 

The correlations are judged as too low to 
indicate consistency or agreement between the 
raters’ judgments and hence no tests of signifi- 
cance have been applied. It seems reasonable to 
conclude that the judges disagree in their rat- 
ings of the patients. The disagreement may be 
the result of three factors: (a) the hetero- 
geneity of the patient sample, (b) the com- 
plexity of the material judged, and (£) the 
lack of adequate definition of trait terms 
coupled with the use of differential Rorschach 
criteria for judging these traits. 

Brief Report 
` Received September 13, 1954. 
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Anastasi, Anne. Psychological testing. New York: 

Macmillan, 1954. Pp. xiii + 682. $6.75. 

The field of testing has grown so rapidly that 
psychological testing 
cial, or intensive and 
llege text achieves a 
extremes. This is not 


selected examples of te: 
aptitude, and achievement, 
of Personality characteristi 
tories through Pprojecti 


tests, In every instance, the instruments selected for 


and on the pe- 


culiar characteristics techniques and 


Situational tests, — 4.M.G. 


Beck, Samuel J. The six schizo 


terns in children and adults, Research Monograph 


No. 6. New York: American Orthopsychiatric 
` Association, 1954. Pp. xi + 238. $5.00, 


This research monograph reports an 
ciplinary study of outpati 


bhrenias, reaction pat- 


erse factor 
ptive items, One fac- 


7 adults and 5 chil- 

Note,—The reviews were 
and Associate Editors, 
their initials, 


Prepared by the Editor 
who may be identified by 
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tributions to method and proposes useful hypotheses 
for further research. It almost surely does not, as the 


title implies, identify the six schizophrenias. — 
LFS, 


Burt, Cyril. The causes and treatment of backward- 
ness. New York: Philosephical Library, 1953. Pp. 
128. $3.75. 


* The author describes this book as an abridgment 
and revision of his earlier The Backward Child of 
fifteen years ago, The new volume is primarily con- 
cerned with educationally substandard children. We 
think it regrettable that the “educationally” was not 
Incorporated in the new title, since many readers 
‘Will anticipate that the book deals with the mental- 
ly backward. Actually there is more need for ex- 
Position of the multiple causes of scholastic retar- 
dation than of mental subnormality, and the more 
Specific title wauld have drawn a wider audience 
and supplied a more useful purpose. We also wish 
that the author might have elaborated the meaning 
of “educational” backwardness, since slow learning 
as directions as well as degrees. We regret this 
More in the light of the author’s authority, insight, 
and experience which give this exposition both 
breadth and merit, and which in spite of beguiling 
Simplicity, impresses us as excellent comprehension 
of children’s learning barrie. — £.4.D. 


Cronbach, Lee J. Educational psychology. New 
York: Harcourt, Brace, 1954. Pp. xxvii -+ 628. 
$7.50. 


© Cronbach has mase an excellent integration of the 
resources of psychology with the needs of education. 
Psychologists will like this book because of its sound 
but simpla handling of evidence and theory; edu- 
cators will like it because of the clear awareness of 
the realities of the classroom. Students will enjoy 
its lucid writing and attractive format. — L.F.S. 


D, 

English, O. Spurgeon, & Finch, Stuart M. Introduc- 
tion to psychiatry. New York: Norton, 1954. Pp. 
viii + 621. $7.00. 


Intended as a beginning text for medical students, 
Introduction to Psychiatry cas serve as well to ori- 
ent graduate students in psyehology and related so- 
cial sciences to modern psychiatry. Avowedly ‘“dy- 
namic” and Freudian, the treatment in most of the 
Volume is essentially eclectic. It follows rather close- 
Yy the Classification of Mental and Emotional 
wee adopted by the American Psychiatric As- 
een in 1952, In addition to the systematic 
Ret aaa of personality disorders, there are exceJent, 
a chapters on persdhality developmgnt and 
at Saia, child psychiatry, principles of psycho- 
defer” and mental hygiene. The cfiapter on mental 

„ciency is weak. A tremendous amou of psy- 
Rue material is covered in this text, most of it 
a rarily ebrief — perhaps, too brief for reference 
i oo It was designed, “however, as an “intro- 

ton,” ang as such is excellent. — M.K. 
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Hodgson, Kenneth. The deaf and their problems. 
New York: Philosophical Library, 1954. Pp. xx + 
348. $6.00. t 


The author has divided the book into three sec- 
tions. The first part is on the ear and the mechanism 
of hearing. Part two is a historical survey of the 
problems of the deaf from ancient and medieval 
times. Part three is a discussion of the problems of 
the deaf in the twentieth century. Because we often 
learn from the mistakes of the past, the book fur- 
nishes excellent background material for one who is 
interested in the problems of the deaf and in mod- 
ern-day solutions. The author strongly favors the 
view that the conflict between the oral and silent 
methods of teaching the deaf should have been al- 
lowed to die out; there should be experimental effort 
on an international scale on the correct teaching of 
the deaf. While work in America is mentioned, the 
author seems much better informed on the methods 
used in Europe and the British Isles. The book is 
strongly oriented toward English problems and 
schools, — B.M.L. 


Hurlock, Elizabeth B. Developmental psychology. 
New York: McGraw-Hill, 1953. Pp. ix + 556. 
$6.00. 


“The purpose of this book is to give as complete a 
picture of the developmental changes of the total life 
span of the human being as is possible within the 
two covers of one book.” These changes are pri- 
marily psychological, with only sketchy reference 
to the medical and social aspects. This volume ap- 
parently telescopes material from the author’s earlier 
successful books on child and adolescent develop- 
ment, with the addition of chapters on adulthood 
and old age. The contents are impressive for both 
generalization and detail. The coverage is broad and 
eclectic yet skillfully discriminative. Obviously no 
serious depth could be included throughout, but one 
gets the impression of an adequate and scholarly 
survey of a field which has rapidly reached its own 
fruitful maturity. — E.A.D. 


Lazarsfeld, Paul F. (Ed.) Mathematical thinking in 
the social sciences. Glencoe, Ill.: Free Press, 1954. 
Pp. 444. $10.00. 


These papers, by eight authors, were selected as 
examples of situations which might typically devel- 
op between the social sciences and mathematics. Thif 
is certainly an important book, but most of it is ex- 
tremely difficult for the social scientist with no more 
than the “modicum of training in mathematics” sug- 
gested by the editor as sufficient, Anderson dèvelops 
a model for analyzing changes in attitudes over 
time on the basis of analysis of stozhastic processes. 
Its application is demonstrated with a panel study 
of potential voters who were interviewed six times 
during an election campaign. More general thodels 
are also developed. Rashevsky expresses basic prob- 


- lems in interpersonal contacts in terms of edifferen- 


eo 
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tial equations, His first paper deals with imitative 
behavior and the second with the distribution of 
status and its alteration through repeated contacts. 
Coleman gives a further explication of Rashevsky’s 
models, including two others in his analysis, and 
shows specific relations between the mathematical 
elements of the models and the elements of the con- 
crete social situations, Marschak discusses the role 
of probability theory in the social sciences with em- 
phasis on “subjective probability.” As an example of 
the relation between probabilistic models and social 
problems he analyzes the effect of a government tax 
policy. Guttman’s first contribution is a develop- 
ment of the psychological implications of the mathe- 
matics of his scalogram analysis, already well known 
to psychologists. The second presents a generalized 
form of factor analysis. Lazarsfeld’s Paper concerns 
the relations between social research procedures and 
the basic equations of latent structure analysis. Si- 
mon contributes a general discussion of model 
building in the social sciences, — A.R. 


Lorand, Sandor, (Ed.) The yearbook 
analysis. New York: International 
Press, 1954. Pp. 350. $7.50. 


of psycho- 
Universities 


The ninth yolume of the Yearb 
predecessors in furnishing a range of papers, re- 
printed from other Sources, representing both the- 
oretical and clinical contributions to psychoanalysis, 
While many of the writings expand, interpret, or 
Paraphrase Freud, the total Sweep of the volume is 
such that a diversity of contemporary viewpoints js 
provided. In the reviewer's opinion, the Papers by 
the Bernfelds (“Freud’s First Year in Practice”) 
by Klein (“The Origins of Tran: y 
Szasz (“On the Psychoan 
stincts”), by Lewin ( 
Interpretation”), by 
in Psychosomatic Disease and 
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author's professional identity. 
butions of psychology appear to hav 3 
ly forgotten in favor of a wholesale ie Pease 
psychoanalytic orthodoxies. W hile this bea Eai 
have heuristic importance as an illustra : psycho 
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kind of literature, especially when prepa i 
outstanding psychologist. — E.J.S. ied with 
Sarason, Seymour B. The clinical oo" aroki 

special reference to the Rorschac h. 

Harper, 1954. Pp. x -+ 425. $5.00. 
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Sarason has produced a unique ae as $, 
stimulating one. The book is infonde nd was de 
text for instruction in the magn it is ™ 
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more than a Rorschaga book. Its thesis iti 
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therapy, and psychodiagnostics. Only oP ia vel 
does the student meet the Rorschach itse!*y Jocatlo” 
written series of chapters on instruction a ra 
color, shading, movement, form, tone anl e d 
tegrated interpretation. Extensive i Porsch? 
research findings; no other work 109. mud ae 
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first-born children to stress determined by the return 
of the father from overseas is outstanding for its 
testing of clinically conceived hypotheses by means 
of objective and appropriate methods. Nineteen fami- 
lies, separated by war during the first pregnancy of 
the mother and reunited after the first child was 
at least one year old, constitute the major group for 
study. These families are compared with control 
‘groups of families in which separation did not oc- 
cur. The major hypothesis of the study is that the 
War-separated families show adjustment difficulties, 
particularly between father and child, and that the 
father’s attitude affects the development of the child 
advérsely. Methods of testing this and other hy- 

were devised with care, and included in- 


Pothes 
terviews with fathers and mothers, free observations 
of children with peers and adults, and studies of 
chiidren in projective play situations, such as ag- 
gression with balloons and blocking, doll play, story 
completions, and dramatic play completions. The 
Major and minor results of the study are numerous 
and highly significant for our understanding of per- 
sonality development in early infant-parent inter- 
action, The dynamic pattern of father-child rivalry 
for the mother, withdrawal by the child, and con- 
Sequent paterng| distress shown in the development 
of authoritarian attitudes, for example, provides an 
important contribution to cur knowledge of how 
adjustive techniques evolve. — 4. M. G. 


Harry Stack. The psychiatric interview. 


Sullivan, 
+ 246. $4.50. 


New York: Norton, 1954. Pp. xxiii 


o 

In this volume’ Ctto Will has organized some of 
the lectures gnd writings on interviewing by the late 
Harry Stack Sullivan. Dr. Will has done an excel- 
lent editogial job and contributed a helpful intro- 
duction. Sullivan’s comments are both learned and 
lively. He thoroughly understood the interpersonal 
dynamics of interviewing, and writes of it with 
evident enjoyment. His style is penetrating and salty, 
combining a feeling for the theoretical significance 
with a flare for earthy interpretation. The clinician 
who reads this book will learn a lot about inter- 
viewing and a lot about Harry Stack Sullivan, and 
he wiR have a delightful time doing it. — W. A. H. 


Swartz, Harry. The allergic child. New York: Cow- 
ard-McCann, 1954. Pp. 297. $3.95. 


functorily alerted to the dis- 
ces of allergic idiosyncracies. 
But relatively few laymen appreciate the multiple 
consequences, both direct and secondary, associated 
with such morbifl sensitivities. Hence this book may 
well impress some readers as rabid and even propa- 
Asandistic. There is, indeed, an initial aura of patent- 
medicine advertising that creates fear or at least 
skeptical apprehension which then changes ’to earnest 
concern. The widespread ramifications of body- 
system dartiage are perhapszless understood than the 
dynamic, behavioral, and learning sequelae. The re- 
viewer is ui equal to appraising the strictly somatic 
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significances, but anyone touched with allergy or as- 
sociated with allergy-prone children will acquire a 
more informed and determined view of this per- 
vasive distress. The child-guidance therapist will 
find herein one more and highly significant desider- 
atum in his appraisals of the problems of children 
and adults. — E. A. D. 


Westwood, Gordon. Society and the homosexual. 
New York: Dutton, 1953. Pp. 191. $3.00. 


“This is not a medical treatise, but an attempt to 
evaluate the social implications of homosexuality”. 
It “includes sexual activities . . . between two adult 
men. It does zot include infantile and early pubertal 
homosexuality . . . and it does no? include the pseu- 
do-homosexuals or the infanto-homosexuals.” Its 
“case,” as noted by Dr. Edward Glover's introduc- 
tion, is “in brief, that homosexuality . . . is not... 
the lecherous perversion of self-indulgent degener- 
ates, but... a powerful unconscious force to which, 
in other forms, civilization owes much of its strength 
and some of the greatest of its achievements.” In 
short it offers a sympathetic exposition of the more 
recently tolerant and analytically insightful interpre- 
tations without, it seems to the reviewer, adding 
materially thereto. — E. A. D. 
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Andrew, Gwen, Hartwell, Samuel W., Hutt, Max 
L., & Walton, Ralph E. Michigan Picture Test. 
Ages 8-14. Individual or small-group test. 1 form. 
Untimed. Set of 16 plates ($6.00) ; analysis sheets 
($1.60 per 20) 5 Manual, pp. xxiii -+ 108, ($2.00). 
Also, Rating Scale for Pupil Adjustment ($1.15 
per 20); with manual, pp. 4+; specimen set ($9.00). 
Chicago: Science Research Associates, 1953. 

The Michigan Picture Test is a new appercep- 
tion test for children 8 to 14 years of age, developed 
through seven years of research by the Michigan 
Department of Mental Health. No other picture- 
story test has been accompanied by so much data 
relevant to its standardization and validation. The 
test may be used in several ways. For screening, four 
“core” pictures are used, which represent a family 
situation, a peer-group situation, lightning at night, 
and a blank card. Responses to these four plates may 
be scored for variables validated against a criterion 
of teacher ratings of adjustment — tension index, 
verb tense, and direction of forces — from which a; 
seein err ap i index may be obtained. 
ets ite iability is good, but there are no data 
praelia zi ee reliability. The analysis sheet 
genets ay or recording four more variables 

ely — interpersonal relations, personal 


< pronouns, popular objects, and psychosexual lefel — 


but users are warned that these scotes bore no signif- 

icant relation to the criterion. An entire series 2 

_ twelve plates, four of which have separate, cards 

for boys and girls, may be used for full clinical 

study. The well-prepared manual contains, an ge 

by Hutt on the, psychology of picture tests, and a fu 
T Qe a 
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account by the other authors of the selection of me 
pictures and the validation and standardization = 
the test. The Michigan pictures provide a usefu 
clinical tool for an age group hitherto ignored in 
the construction of apperception tests.—L. F. S. 
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